Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4681 originally caused by: Started by upstream project "master-osmo-trx" build number 4890 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7510 originally caused by: Started by upstream project "master-osmo-bts" build number 7574 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5537 originally caused by: Started by upstream project "master-osmo-bts" build number 7574 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8041 originally caused by: Started by upstream project "master-osmo-bts" build number 7574 originally caused by: Started by an SCM change Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7510 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6690 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8713 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8959 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2985 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29304 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30088 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4681 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12989 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9255 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4710 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8041 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5537 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins852822607426517698.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-13 11:32:40 + trial_dir_prefix=trial- + rm -rf trial-2388 trial-2388-bin.tgz trial-2388-run.tgz + trial_dir=trial-2389 + mkdir -p trial-2389 + mv open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2985.tgz osmo-mgw.build-8959.tgz osmo-msc.build-29304.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30088.tgz osmo-stp.build-9255.tgz osmo-trx.build-4681.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz trial-2389 + cat open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2985.md5 osmo-mgw.build-8959.md5 osmo-msc.build-29304.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30088.md5 osmo-stp.build-9255.md5 osmo-trx.build-4681.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2985.md5 osmo-mgw.build-8959.md5 osmo-msc.build-29304.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30088.md5 osmo-stp.build-9255.md5 osmo-trx.build-4681.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2389 combinations: None trial: 'trial-2389' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2389 -------------------------------------------------------------------------------------------- 11:32:52.509321 tst trial-2389: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/log --------------------------------------------------------------------- trial-2389 nitb_sms:sysmo --------------------------------------------------------------------- 11:35:02.191716 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:02.195269 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 11:35:02.220284 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 11:35:02.228258 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 11:35:02.286756 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 11:35:02.307528 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 11:35:02.314406 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 11:35:02.855998 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 11:35:02.861377 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 11:35:02.872639 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 11:35:03.261607 tst mo_mt_sms.py: using LAC 33664 11:35:03.508337 tst mo_mt_sms.py: using RAC 4 11:35:03.632181 tst mo_mt_sms.py: using CellId 33664 11:35:03.757756 tst mo_mt_sms.py: using BVCI 33665 11:35:03.865406 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 11:35:04.042833 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 11:35:04.162405 tst mo_mt_sms.py:9: start nitb and bts... 11:35:04.381404 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:35:06.748751 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14432): Launched 11:35:07.075375 run osmo-nitb_10.42.42.2(pid=14433): Launched 11:35:07.253649 run osmo-nitb_10.42.42.2(pid=14433): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14433)] 11:35:07.387036 run osmo-nitb_10.42.42.2(pid=14433): stdout: | (launched: 2022-12-13_11:35:07.015387) 11:35:07.522295 run osmo-nitb_10.42.42.2(pid=14433): stderr: | (launched: 2022-12-13_11:35:07.063479) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:35:07.657195 run osmo-nitb_10.42.42.2(pid=14433): stdout: | (launched: 2022-12-13_11:35:07.015387) 11:35:07.786173 run osmo-nitb_10.42.42.2(pid=14433): stderr: | (launched: 2022-12-13_11:35:07.063479) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:35:07.939902 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14433): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14433) [trial-2389↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14433)] [trial-2389↪nitb_sms:sysmo↪mo_mt_sms.py:11] 11:35:07.948824 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 11:35:07.955779 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14432): Terminating (SIGTERM) 11:35:08.166628 --- ParallelTerminationStrategy: PID 14432 died... 11:35:08.188427 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14432): Terminated: ok {rc=0} 11:35:08.277366 bus /sierra_3: Setting Powered False 11:35:09.378519 bus /sierra_3: Setting Powered False 11:35:10.494202 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 sms:sysmo --------------------------------------------------------------------- 11:35:11.674178 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:11.678156 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 11:35:11.698986 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 11:35:11.726643 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 11:35:11.780062 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 11:35:11.801280 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 11:35:11.828106 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 11:35:12.373873 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 sms:sysmo mo_mt_sms.py ---------------------------------------------- 11:35:12.379063 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:35:12.389900 tst sms:sysmo: Using 1 x bts (candidates: 1) 11:35:12.424341 tst mo_mt_sms.py: using LAC 33665 11:35:12.545422 tst mo_mt_sms.py: using RAC 5 11:35:12.664230 tst mo_mt_sms.py: using CellId 33665 11:35:12.784857 tst mo_mt_sms.py: using BVCI 33666 11:35:12.895628 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:35:12.906405 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:35:12.917201 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:35:12.927688 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:35:12.938720 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:35:12.950225 tst sms:sysmo: Using 1 x modem (candidates: 2) 11:35:13.065953 tst sms:sysmo: Using 1 x modem (candidates: 2) 11:35:13.189247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:14.930857 run create_hlr_db(pid=14438): Launched 11:35:15.057749 bus /sierra_2: Setting Powered False 11:35:16.125735 run create_hlr_db(pid=14438): Terminated: ok {rc=0} 11:35:16.570573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14440): Launched 11:35:16.899186 run osmo-hlr_10.42.42.2(pid=14441): Launched 11:35:17.111011 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:19.749621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14443): Launched 11:35:20.078347 run osmo-stp_10.42.42.5(pid=14444): Launched 11:35:20.204177 run osmo-msc_10.42.42.6: Starting osmo-msc 11:35:25.682607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14446): Launched 11:35:26.006727 run osmo-msc_10.42.42.6(pid=14447): Launched 11:35:26.187338 run osmo-stp_10.42.42.5(pid=14444): ERR: Terminated: ERROR {rc=1} [trial-2389↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14444)] 11:35:26.323910 run osmo-stp_10.42.42.5(pid=14444): stdout: | (launched: 2022-12-13_11:35:20.017597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:26.460836 run osmo-stp_10.42.42.5(pid=14444): stderr: | 20221213113520212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113520212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113520212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113520212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113520213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113520213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113520213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:26.596880 run osmo-stp_10.42.42.5(pid=14444): stdout: | (launched: 2022-12-13_11:35:20.017597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:26.726108 run osmo-stp_10.42.42.5(pid=14444): stderr: | 20221213113520212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113520212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113520212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113520212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113520213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113520213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113520213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:26.880172 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14444): Process ended prematurely: osmo-stp_10.42.42.5(pid=14444) [trial-2389↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14444)] [trial-2389↪sms:sysmo↪mo_mt_sms.py:16] 11:35:26.889267 tst mo_mt_sms.py:16: Test FAILED (14.5 sec) 11:35:26.916813 run osmo-hlr_10.42.42.2(pid=14441): ERR: Terminated: ERROR {rc=237} [trial-2389↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14441)] 11:35:26.968336 run osmo-hlr_10.42.42.2(pid=14441): stdout: | (launched: 2022-12-13_11:35:16.838655) 11:35:27.021557 run osmo-hlr_10.42.42.2(pid=14441): stderr: | 20221213113517202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113517202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113517202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113517202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113517202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113517202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113517219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113517236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113517236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113517236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:27.095204 run osmo-msc_10.42.42.6(pid=14447): ERR: Terminated: ERROR {rc=2} [trial-2389↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14447)] 11:35:27.146125 run osmo-msc_10.42.42.6(pid=14447): stdout: | (launched: 2022-12-13_11:35:25.946640) 11:35:27.199261 run osmo-msc_10.42.42.6(pid=14447): stderr: | 20221213113526272 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113526272 DLGLOBAL DEBUG validating counter group 0x7fe2ef4cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113526272 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113526272 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113526272 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113526272 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113526274 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113526274 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113526275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113526275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:35:27.252583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14440): Terminating (SIGTERM) 11:35:27.295301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14443): Terminating (SIGTERM) 11:35:27.338189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14446): Terminating (SIGTERM) 11:35:27.381008 --- ParallelTerminationStrategy: PID 14440 died... 11:35:27.401627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14440): Terminated: ok {rc=0} 11:35:27.448630 --- ParallelTerminationStrategy: PID 14443 died... 11:35:27.468756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14443): Terminated: ok {rc=0} 11:35:27.516192 --- ParallelTerminationStrategy: PID 14446 died... 11:35:27.536319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14446): Terminated: ok {rc=0} 11:35:27.626574 bus /sierra_3: Setting Powered False 11:35:28.727395 bus /sierra_3: Setting Powered False 11:35:29.847245 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_ussd:sysmo --------------------------------------------------------------------- 11:35:31.098350 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:31.102096 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 11:35:31.124637 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 11:35:31.132487 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 11:35:31.170623 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 11:35:31.193564 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 11:35:31.201773 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 11:35:31.732741 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 11:35:31.741119 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 11:35:31.758950 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 11:35:31.803410 tst assert_extension.py: using LAC 33666 11:35:31.927129 tst assert_extension.py: using RAC 6 11:35:32.046508 tst assert_extension.py: using CellId 33666 11:35:32.210429 tst assert_extension.py: using BVCI 33667 11:35:32.323693 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 11:35:32.443827 tst assert_extension.py:10: start nitb and bts... 11:35:32.664605 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:35:33.326232 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14453): Launched 11:35:33.653735 run osmo-nitb_10.42.42.2(pid=14454): Launched 11:35:33.835390 run osmo-nitb_10.42.42.2(pid=14454): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14454)] 11:35:33.981340 run osmo-nitb_10.42.42.2(pid=14454): stdout: | (launched: 2022-12-13_11:35:33.593405) 11:35:34.129040 run osmo-nitb_10.42.42.2(pid=14454): stderr: | (launched: 2022-12-13_11:35:33.641596) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:35:34.276768 run osmo-nitb_10.42.42.2(pid=14454): stdout: | (launched: 2022-12-13_11:35:33.593405) 11:35:34.418401 run osmo-nitb_10.42.42.2(pid=14454): stderr: | (launched: 2022-12-13_11:35:33.641596) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14454): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14454) [trial-2389↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14454)] 11:35:34.777884 tst osmo-nitb_10.42.42.2(pid=14454): stdout: | (launched: 2022-12-13_11:35:33.593405) 11:35:34.909074 tst osmo-nitb_10.42.42.2(pid=14454): stderr: | (launched: 2022-12-13_11:35:33.641596) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:35:35.064334 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14454): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14454) [trial-2389↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14454)] [trial-2389↪nitb_ussd:sysmo↪assert_extension.py:12] 11:35:35.073774 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:35:35.081215 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14453): Terminating (SIGTERM) 11:35:35.292932 --- ParallelTerminationStrategy: PID 14453 died... 11:35:35.314592 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14453): Terminated: ok {rc=0} 11:35:35.403392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 ussd:sysmo --------------------------------------------------------------------- 11:35:36.571783 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:36.575602 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 11:35:36.596799 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 11:35:36.623814 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 11:35:36.659414 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 11:35:36.680303 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 11:35:36.706932 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 11:35:37.236710 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 ussd:sysmo assert_extension.py ---------------------------------------------- 11:35:37.242041 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:35:37.252722 tst ussd:sysmo: Using 1 x bts (candidates: 1) 11:35:37.288641 tst assert_extension.py: using LAC 33667 11:35:37.409387 tst assert_extension.py: using RAC 7 11:35:37.529099 tst assert_extension.py: using CellId 33667 11:35:37.649472 tst assert_extension.py: using BVCI 33668 11:35:37.768189 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:35:37.779523 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:35:37.790818 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:35:37.801809 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:35:37.813334 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:35:37.824411 tst ussd:sysmo: Using 1 x modem (candidates: 1) 11:35:37.946054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:38.450922 run create_hlr_db(pid=14458): Launched 11:35:38.576018 bus /sierra_2: Setting Powered False 11:35:39.640338 run create_hlr_db(pid=14458): Terminated: ok {rc=0} 11:35:40.077670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14460): Launched 11:35:40.384177 run osmo-hlr_10.42.42.2(pid=14461): Launched 11:35:40.500066 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:41.030658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14463): Launched 11:35:41.336810 run osmo-stp_10.42.42.5(pid=14464): Launched 11:35:41.452749 run osmo-msc_10.42.42.6: Starting osmo-msc 11:35:42.020082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14466): Launched 11:35:42.348058 run osmo-msc_10.42.42.6(pid=14467): Launched 11:35:42.532290 run osmo-stp_10.42.42.5(pid=14464): ERR: Terminated: ERROR {rc=1} [trial-2389↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14464)] 11:35:42.671558 run osmo-stp_10.42.42.5(pid=14464): stdout: | (launched: 2022-12-13_11:35:41.279887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:42.810312 run osmo-stp_10.42.42.5(pid=14464): stderr: | 20221213113541452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113541452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113541452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113541453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113541455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113541455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113541455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:42.947438 run osmo-stp_10.42.42.5(pid=14464): stdout: | (launched: 2022-12-13_11:35:41.279887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:43.077535 run osmo-stp_10.42.42.5(pid=14464): stderr: | 20221213113541452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113541452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113541452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113541453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113541455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113541455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113541455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:43.233149 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14464): Process ended prematurely: osmo-stp_10.42.42.5(pid=14464) [trial-2389↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14464)] [trial-2389↪ussd:sysmo↪assert_extension.py:17] 11:35:43.242389 tst assert_extension.py:17: Test FAILED (6.0 sec) 11:35:43.270024 run osmo-hlr_10.42.42.2(pid=14461): ERR: Terminated: ERROR {rc=237} [trial-2389↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14461)] 11:35:43.322079 run osmo-hlr_10.42.42.2(pid=14461): stdout: | (launched: 2022-12-13_11:35:40.327250) 11:35:43.375255 run osmo-hlr_10.42.42.2(pid=14461): stderr: | 20221213113540505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113540505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113540506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113540506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113540506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113540506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113540519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113540530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113540530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113540530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:43.448726 run osmo-msc_10.42.42.6(pid=14467): ERR: Terminated: ERROR {rc=2} [trial-2389↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14467)] 11:35:43.499161 run osmo-msc_10.42.42.6(pid=14467): stdout: | (launched: 2022-12-13_11:35:42.287451) 11:35:43.552340 run osmo-msc_10.42.42.6(pid=14467): stderr: | 20221213113542608 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113542608 DLGLOBAL DEBUG validating counter group 0x7f2cbe695c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113542609 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113542609 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113542609 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113542609 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113542612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113542613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113542613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113542613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:35:43.605546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14460): Terminating (SIGTERM) 11:35:43.647772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14463): Terminating (SIGTERM) 11:35:43.690868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14466): Terminating (SIGTERM) 11:35:43.733968 --- ParallelTerminationStrategy: PID 14460 died... 11:35:43.754589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14460): Terminated: ok {rc=0} 11:35:43.801775 --- ParallelTerminationStrategy: PID 14463 died... 11:35:43.822128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14463): Terminated: ok {rc=0} 11:35:43.869442 --- ParallelTerminationStrategy: PID 14466 died... 11:35:43.889876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14466): Terminated: ok {rc=0} 11:35:43.979708 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:35:45.180855 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:45.187952 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:35:45.209748 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:35:45.239633 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:35:45.298345 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:35:45.320147 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:35:45.347221 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:35:45.894975 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:35:45.960500 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:45.972448 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:35:46.030310 tst mo_mt_call.py: using LAC 33668 11:35:46.156500 tst mo_mt_call.py: using RAC 8 11:35:46.292860 tst mo_mt_call.py: using CellId 33668 11:35:46.415578 tst mo_mt_call.py: using BVCI 33669 11:35:46.529454 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:46.541748 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:46.553411 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:46.565261 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:46.577595 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:46.589837 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:35:46.735081 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:35:46.879175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:47.426755 run create_hlr_db(pid=14472): Launched 11:35:47.556475 bus /sierra_2: Setting Powered False 11:35:48.618645 run create_hlr_db(pid=14472): Terminated: ok {rc=0} 11:35:49.072592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14474): Launched 11:35:49.407802 run osmo-hlr_10.42.42.2(pid=14475): Launched 11:35:49.536453 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:50.113821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14477): Launched 11:35:50.445149 run osmo-stp_10.42.42.5(pid=14478): Launched 11:35:50.563992 run osmo-msc_10.42.42.6: Starting osmo-msc 11:35:51.125495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14480): Launched 11:35:51.437529 run osmo-msc_10.42.42.6(pid=14481): Launched 11:35:51.611321 run osmo-stp_10.42.42.5(pid=14478): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14478)] 11:35:51.741923 run osmo-stp_10.42.42.5(pid=14478): stdout: | (launched: 2022-12-13_11:35:50.383732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:51.880849 run osmo-stp_10.42.42.5(pid=14478): stderr: | 20221213113550559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113550559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113550559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113550560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113550560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113550560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113550560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:52.019096 run osmo-stp_10.42.42.5(pid=14478): stdout: | (launched: 2022-12-13_11:35:50.383732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:52.150847 run osmo-stp_10.42.42.5(pid=14478): stderr: | 20221213113550559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113550559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113550559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113550560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113550560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113550560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113550560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:52.308198 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14478): Process ended prematurely: osmo-stp_10.42.42.5(pid=14478) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14478)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:35:52.317699 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:35:52.345426 run osmo-hlr_10.42.42.2(pid=14475): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14475)] 11:35:52.396410 run osmo-hlr_10.42.42.2(pid=14475): stdout: | (launched: 2022-12-13_11:35:49.346342) 11:35:52.448879 run osmo-hlr_10.42.42.2(pid=14475): stderr: | 20221213113549549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113549549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113549549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113549549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113549549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113549549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113549572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113549582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113549582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113549582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:52.522051 run osmo-msc_10.42.42.6(pid=14481): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14481)] 11:35:52.572650 run osmo-msc_10.42.42.6(pid=14481): stdout: | (launched: 2022-12-13_11:35:51.379329) 11:35:52.624928 run osmo-msc_10.42.42.6(pid=14481): stderr: | 20221213113551656 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113551656 DLGLOBAL DEBUG validating counter group 0x7fe03ab79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113551656 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113551656 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113551657 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113551657 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113551658 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113551659 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113551659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113551659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:35:52.677992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14474): Terminating (SIGTERM) 11:35:52.720160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14477): Terminating (SIGTERM) 11:35:52.762460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14480): Terminating (SIGTERM) 11:35:52.805663 --- ParallelTerminationStrategy: PID 14474 died... 11:35:52.826213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14474): Terminated: ok {rc=0} 11:35:52.873051 --- ParallelTerminationStrategy: PID 14477 died... 11:35:52.893063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14477): Terminated: ok {rc=0} 11:35:52.939750 --- ParallelTerminationStrategy: PID 14480 died... 11:35:52.959664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14480): Terminated: ok {rc=0} 11:35:53.048626 bus /sierra_3: Setting Powered False 11:35:54.149115 bus /sierra_3: Setting Powered False 11:35:55.265598 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:35:56.418657 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:56.430993 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:35:56.491425 tst mo_mt_call_osmux.py: using LAC 33669 11:35:56.623613 tst mo_mt_call_osmux.py: using RAC 9 11:35:56.753250 tst mo_mt_call_osmux.py: using CellId 33669 11:35:56.883679 tst mo_mt_call_osmux.py: using BVCI 33670 11:35:57.006213 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:57.017849 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:57.029295 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:57.040632 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:57.052518 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:35:57.064306 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:35:57.181744 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:35:57.302722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:57.819237 run create_hlr_db(pid=14486): Launched 11:35:57.946296 bus /sierra_2: Setting Powered False 11:35:59.011721 run create_hlr_db(pid=14486): Terminated: ok {rc=0} 11:35:59.456858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14488): Launched 11:35:59.767451 run osmo-hlr_10.42.42.2(pid=14489): Launched 11:35:59.886999 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:00.439356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14491): Launched 11:36:00.751116 run osmo-stp_10.42.42.5(pid=14492): Launched 11:36:00.880443 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:01.567494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14494): Launched 11:36:01.897586 run osmo-msc_10.42.42.6(pid=14495): Launched 11:36:02.307320 run osmo-stp_10.42.42.5(pid=14492): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14492)] 11:36:02.470088 run osmo-stp_10.42.42.5(pid=14492): stdout: | (launched: 2022-12-13_11:36:00.693203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:02.608376 run osmo-stp_10.42.42.5(pid=14492): stderr: | 20221213113600889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113600889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113600889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113600890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113600892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113600892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113600892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:02.746497 run osmo-stp_10.42.42.5(pid=14492): stdout: | (launched: 2022-12-13_11:36:00.693203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:02.878710 run osmo-stp_10.42.42.5(pid=14492): stderr: | 20221213113600889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113600889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113600889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113600890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113600892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113600892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113600892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:03.036605 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14492): Process ended prematurely: osmo-stp_10.42.42.5(pid=14492) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14492)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:36:03.046594 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 11:36:03.074457 run osmo-hlr_10.42.42.2(pid=14489): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14489)] 11:36:03.125988 run osmo-hlr_10.42.42.2(pid=14489): stdout: | (launched: 2022-12-13_11:35:59.709541) 11:36:03.178922 run osmo-hlr_10.42.42.2(pid=14489): stderr: | 20221213113559890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113559890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113559890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113559890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113559890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113559890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113559902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113559913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113559913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113559913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:03.252149 run osmo-msc_10.42.42.6(pid=14495): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14495)] 11:36:03.302717 run osmo-msc_10.42.42.6(pid=14495): stdout: | (launched: 2022-12-13_11:36:01.836770) 11:36:03.355639 run osmo-msc_10.42.42.6(pid=14495): stderr: | 20221213113602336 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113602336 DLGLOBAL DEBUG validating counter group 0x7f51a7b58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113602336 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113602336 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113602337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113602337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113602338 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113602339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113602339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113602339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:03.408262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14488): Terminating (SIGTERM) 11:36:03.450881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14491): Terminating (SIGTERM) 11:36:03.493861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14494): Terminating (SIGTERM) 11:36:03.537085 --- ParallelTerminationStrategy: PID 14488 died... 11:36:03.557753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14488): Terminated: ok {rc=0} 11:36:03.604886 --- ParallelTerminationStrategy: PID 14491 died... 11:36:03.625650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14491): Terminated: ok {rc=0} 11:36:03.672490 --- ParallelTerminationStrategy: PID 14494 died... 11:36:03.692575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14494): Terminated: ok {rc=0} 11:36:03.782053 bus /sierra_3: Setting Powered False 11:36:04.881175 bus /sierra_3: Setting Powered False 11:36:06.000018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:36:07.235414 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:07.241643 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:36:07.262603 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:36:07.289608 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:36:07.341479 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:36:07.362253 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:36:07.388704 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:36:07.944055 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:36:07.993087 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:08.004148 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:36:08.061513 tst mo_mt_call.py: using LAC 33670 11:36:08.187654 tst mo_mt_call.py: using RAC 10 11:36:08.309621 tst mo_mt_call.py: using CellId 33670 11:36:08.429190 tst mo_mt_call.py: using BVCI 33671 11:36:08.542496 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:08.553755 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:08.564691 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:08.575627 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:08.586706 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:08.597648 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:36:08.719807 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:36:08.837299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:09.317217 run create_hlr_db(pid=14500): Launched 11:36:09.443163 bus /sierra_2: Setting Powered False 11:36:10.503923 run create_hlr_db(pid=14500): Terminated: ok {rc=0} 11:36:10.934934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14502): Launched 11:36:11.246382 run osmo-hlr_10.42.42.2(pid=14503): Launched 11:36:11.363099 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:11.898640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14505): Launched 11:36:12.207846 run osmo-stp_10.42.42.5(pid=14506): Launched 11:36:12.326302 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:12.886325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14508): Launched 11:36:13.198254 run osmo-msc_10.42.42.6(pid=14509): Launched 11:36:13.371950 run osmo-stp_10.42.42.5(pid=14506): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14506)] 11:36:13.502675 run osmo-stp_10.42.42.5(pid=14506): stdout: | (launched: 2022-12-13_11:36:12.150106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:13.632449 run osmo-stp_10.42.42.5(pid=14506): stderr: | 20221213113612325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113612325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113612325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113612326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113612326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113612326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113612327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:13.760749 run osmo-stp_10.42.42.5(pid=14506): stdout: | (launched: 2022-12-13_11:36:12.150106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:13.883035 run osmo-stp_10.42.42.5(pid=14506): stderr: | 20221213113612325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113612325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113612325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113612326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113612326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113612326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113612327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:14.029457 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14506): Process ended prematurely: osmo-stp_10.42.42.5(pid=14506) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14506)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:36:14.038317 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:36:14.064442 run osmo-hlr_10.42.42.2(pid=14503): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14503)] 11:36:14.112768 run osmo-hlr_10.42.42.2(pid=14503): stdout: | (launched: 2022-12-13_11:36:11.188508) 11:36:14.162261 run osmo-hlr_10.42.42.2(pid=14503): stderr: | 20221213113611369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113611369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113611369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113611369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113611369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113611369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113611383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113611396 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113611396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113611396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:14.230969 run osmo-msc_10.42.42.6(pid=14509): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14509)] 11:36:14.278515 run osmo-msc_10.42.42.6(pid=14509): stdout: | (launched: 2022-12-13_11:36:13.139910) 11:36:14.327712 run osmo-msc_10.42.42.6(pid=14509): stderr: | 20221213113613416 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113613416 DLGLOBAL DEBUG validating counter group 0x7fcae92cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113613416 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113613416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113613416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113613416 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113613418 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113613419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113613419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113613419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:14.377292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14502): Terminating (SIGTERM) 11:36:14.416628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14505): Terminating (SIGTERM) 11:36:14.456027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14508): Terminating (SIGTERM) 11:36:14.495777 --- ParallelTerminationStrategy: PID 14502 died... 11:36:14.514707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14502): Terminated: ok {rc=0} 11:36:14.558348 --- ParallelTerminationStrategy: PID 14505 died... 11:36:14.576730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14505): Terminated: ok {rc=0} 11:36:14.620722 --- ParallelTerminationStrategy: PID 14508 died... 11:36:14.639344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14508): Terminated: ok {rc=0} 11:36:14.725333 bus /sierra_3: Setting Powered False 11:36:15.826849 bus /sierra_3: Setting Powered False 11:36:16.964460 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:36:18.151409 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:18.163904 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:36:18.225842 tst mo_mt_call_osmux.py: using LAC 33671 11:36:18.346773 tst mo_mt_call_osmux.py: using RAC 11 11:36:18.469342 tst mo_mt_call_osmux.py: using CellId 33671 11:36:18.592218 tst mo_mt_call_osmux.py: using BVCI 33672 11:36:18.715397 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:18.727264 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:18.738988 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:18.750959 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:18.763103 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:18.775044 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:36:18.892467 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:36:19.015617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:19.531756 run create_hlr_db(pid=14511): Launched 11:36:19.661321 bus /sierra_2: Setting Powered False 11:36:20.727110 run create_hlr_db(pid=14511): Terminated: ok {rc=0} 11:36:21.171296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14513): Launched 11:36:21.483701 run osmo-hlr_10.42.42.2(pid=14514): Launched 11:36:21.605891 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:22.143883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14516): Launched 11:36:22.456796 run osmo-stp_10.42.42.5(pid=14517): Launched 11:36:22.576867 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:23.157925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14519): Launched 11:36:23.468294 run osmo-msc_10.42.42.6(pid=14520): Launched 11:36:23.644319 run osmo-stp_10.42.42.5(pid=14517): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14517)] 11:36:23.775244 run osmo-stp_10.42.42.5(pid=14517): stdout: | (launched: 2022-12-13_11:36:22.398546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:23.905448 run osmo-stp_10.42.42.5(pid=14517): stderr: | 20221213113622574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113622574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113622574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113622575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113622575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113622575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113622575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:24.034476 run osmo-stp_10.42.42.5(pid=14517): stdout: | (launched: 2022-12-13_11:36:22.398546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:24.157650 run osmo-stp_10.42.42.5(pid=14517): stderr: | 20221213113622574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113622574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113622574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113622575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113622575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113622575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113622575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:24.304724 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14517): Process ended prematurely: osmo-stp_10.42.42.5(pid=14517) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14517)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:36:24.313755 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:36:24.340272 run osmo-hlr_10.42.42.2(pid=14514): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14514)] 11:36:24.388456 run osmo-hlr_10.42.42.2(pid=14514): stdout: | (launched: 2022-12-13_11:36:21.425628) 11:36:24.438324 run osmo-hlr_10.42.42.2(pid=14514): stderr: | 20221213113621604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113621605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113621605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113621605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113621605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113621605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113621618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113621627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113621627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113621627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:24.507652 run osmo-msc_10.42.42.6(pid=14520): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14520)] 11:36:24.555692 run osmo-msc_10.42.42.6(pid=14520): stdout: | (launched: 2022-12-13_11:36:23.410232) 11:36:24.605513 run osmo-msc_10.42.42.6(pid=14520): stderr: | 20221213113623686 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113623686 DLGLOBAL DEBUG validating counter group 0x7fc5368d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113623686 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113623686 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113623687 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113623687 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113623689 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113623689 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113623689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113623689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:24.655510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14513): Terminating (SIGTERM) 11:36:24.695417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14516): Terminating (SIGTERM) 11:36:24.735197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14519): Terminating (SIGTERM) 11:36:24.775210 --- ParallelTerminationStrategy: PID 14513 died... 11:36:24.794505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14513): Terminated: ok {rc=0} 11:36:24.838861 --- ParallelTerminationStrategy: PID 14516 died... 11:36:24.857721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14516): Terminated: ok {rc=0} 11:36:24.901654 --- ParallelTerminationStrategy: PID 14519 died... 11:36:24.920358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14519): Terminated: ok {rc=0} 11:36:25.007459 bus /sierra_3: Setting Powered False 11:36:26.108215 bus /sierra_3: Setting Powered False 11:36:27.222312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:36:28.464883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:28.472027 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:36:28.493877 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:36:28.522779 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:36:28.577338 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:36:28.599315 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:36:28.627477 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:36:29.178829 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:36:29.232733 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:29.244336 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:36:29.303043 tst mo_mt_call.py: using LAC 33672 11:36:29.435715 tst mo_mt_call.py: using RAC 12 11:36:29.563013 tst mo_mt_call.py: using CellId 33672 11:36:29.684918 tst mo_mt_call.py: using BVCI 33673 11:36:29.797059 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:29.808449 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:29.819637 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:29.830636 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:29.841579 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:29.852495 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:36:29.969349 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:36:30.089277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:30.605736 run create_hlr_db(pid=14525): Launched 11:36:30.732359 bus /sierra_2: Setting Powered False 11:36:31.793622 run create_hlr_db(pid=14525): Terminated: ok {rc=0} 11:36:32.323652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14527): Launched 11:36:32.659101 run osmo-hlr_10.42.42.2(pid=14528): Launched 11:36:32.787364 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:33.362187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14530): Launched 11:36:33.697617 run osmo-stp_10.42.42.5(pid=14531): Launched 11:36:33.824459 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:34.427111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14533): Launched 11:36:34.761706 run osmo-msc_10.42.42.6(pid=14534): Launched 11:36:34.945408 run osmo-stp_10.42.42.5(pid=14531): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14531)] 11:36:35.084833 run osmo-stp_10.42.42.5(pid=14531): stdout: | (launched: 2022-12-13_11:36:33.635793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:35.224724 run osmo-stp_10.42.42.5(pid=14531): stderr: | 20221213113633830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113633830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113633830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113633831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113633831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113633831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113633831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:35.364047 run osmo-stp_10.42.42.5(pid=14531): stdout: | (launched: 2022-12-13_11:36:33.635793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:35.496377 run osmo-stp_10.42.42.5(pid=14531): stderr: | 20221213113633830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113633830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113633830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113633831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113633831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113633831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113633831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:35.655724 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14531): Process ended prematurely: osmo-stp_10.42.42.5(pid=14531) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14531)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:36:35.665532 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:36:35.693538 run osmo-hlr_10.42.42.2(pid=14528): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14528)] 11:36:35.745106 run osmo-hlr_10.42.42.2(pid=14528): stdout: | (launched: 2022-12-13_11:36:32.597598) 11:36:35.797624 run osmo-hlr_10.42.42.2(pid=14528): stderr: | 20221213113632797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113632797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113632797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113632797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113632797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113632797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113632810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113632818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113632819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113632819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:35.870916 run osmo-msc_10.42.42.6(pid=14534): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14534)] 11:36:35.921446 run osmo-msc_10.42.42.6(pid=14534): stdout: | (launched: 2022-12-13_11:36:34.699849) 11:36:35.974308 run osmo-msc_10.42.42.6(pid=14534): stderr: | 20221213113635028 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113635028 DLGLOBAL DEBUG validating counter group 0x7f7d30edac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113635028 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113635028 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113635029 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113635029 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113635031 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113635031 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113635031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113635031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:36.027445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14527): Terminating (SIGTERM) 11:36:36.069714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14530): Terminating (SIGTERM) 11:36:36.112740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14533): Terminating (SIGTERM) 11:36:36.155642 --- ParallelTerminationStrategy: PID 14527 died... 11:36:36.176124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14527): Terminated: ok {rc=0} 11:36:36.223287 --- ParallelTerminationStrategy: PID 14530 died... 11:36:36.243463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14530): Terminated: ok {rc=0} 11:36:36.290254 --- ParallelTerminationStrategy: PID 14533 died... 11:36:36.310380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14533): Terminated: ok {rc=0} 11:36:36.399603 bus /sierra_3: Setting Powered False 11:36:37.498969 bus /sierra_3: Setting Powered False 11:36:38.616677 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:36:39.768514 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:39.780889 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:36:39.839645 tst mo_mt_call_osmux.py: using LAC 33673 11:36:39.969677 tst mo_mt_call_osmux.py: using RAC 13 11:36:40.092428 tst mo_mt_call_osmux.py: using CellId 33673 11:36:40.219529 tst mo_mt_call_osmux.py: using BVCI 33674 11:36:40.333505 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:40.344760 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:40.355862 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:40.366982 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:40.377994 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:36:40.389034 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:36:40.509270 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:36:40.630955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:41.148672 run create_hlr_db(pid=14536): Launched 11:36:41.277162 bus /sierra_2: Setting Powered False 11:36:42.342836 run create_hlr_db(pid=14536): Terminated: ok {rc=0} 11:36:42.805884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14538): Launched 11:36:43.140312 run osmo-hlr_10.42.42.2(pid=14539): Launched 11:36:43.269372 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:43.841855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14541): Launched 11:36:44.176109 run osmo-stp_10.42.42.5(pid=14542): Launched 11:36:44.303855 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:44.904105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14544): Launched 11:36:45.238378 run osmo-msc_10.42.42.6(pid=14545): Launched 11:36:45.423760 run osmo-stp_10.42.42.5(pid=14542): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14542)] 11:36:45.564197 run osmo-stp_10.42.42.5(pid=14542): stdout: | (launched: 2022-12-13_11:36:44.114617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:45.704779 run osmo-stp_10.42.42.5(pid=14542): stderr: | 20221213113644308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113644308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113644309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113644309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113644309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113644309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113644310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:45.844646 run osmo-stp_10.42.42.5(pid=14542): stdout: | (launched: 2022-12-13_11:36:44.114617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:46.006607 run osmo-stp_10.42.42.5(pid=14542): stderr: | 20221213113644308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113644308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113644309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113644309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113644309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113644309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113644310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:46.159551 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14542): Process ended prematurely: osmo-stp_10.42.42.5(pid=14542) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14542)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:36:46.169268 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:36:46.197331 run osmo-hlr_10.42.42.2(pid=14539): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14539)] 11:36:46.247179 run osmo-hlr_10.42.42.2(pid=14539): stdout: | (launched: 2022-12-13_11:36:43.078790) 11:36:46.298843 run osmo-hlr_10.42.42.2(pid=14539): stderr: | 20221213113643279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113643279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113643279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113643279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113643280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113643280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113643291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113643299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113643300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113643300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:46.369821 run osmo-msc_10.42.42.6(pid=14545): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14545)] 11:36:46.419051 run osmo-msc_10.42.42.6(pid=14545): stdout: | (launched: 2022-12-13_11:36:45.176417) 11:36:46.471740 run osmo-msc_10.42.42.6(pid=14545): stderr: | 20221213113645502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113645502 DLGLOBAL DEBUG validating counter group 0x7f2f282b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113645502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113645502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113645502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113645502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113645504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113645504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113645505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113645505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:46.522818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14538): Terminating (SIGTERM) 11:36:46.564663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14541): Terminating (SIGTERM) 11:36:46.608199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14544): Terminating (SIGTERM) 11:36:46.653395 --- ParallelTerminationStrategy: PID 14538 died... 11:36:46.673505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14538): Terminated: ok {rc=0} 11:36:46.720138 --- ParallelTerminationStrategy: PID 14541 died... 11:36:46.739749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14541): Terminated: ok {rc=0} 11:36:46.785099 --- ParallelTerminationStrategy: PID 14544 died... 11:36:46.804157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14544): Terminated: ok {rc=0} 11:36:46.892753 bus /sierra_3: Setting Powered False 11:36:47.995543 bus /sierra_3: Setting Powered False 11:36:49.113264 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:36:50.356363 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:50.363383 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:36:50.384870 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:36:50.413419 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:36:50.468248 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:36:50.490237 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:36:50.517812 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:36:51.068270 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:36:51.121958 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:36:51.133673 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:36:51.192130 tst mo_mt_call.py: using LAC 33674 11:36:51.322230 tst mo_mt_call.py: using RAC 14 11:36:51.452550 tst mo_mt_call.py: using CellId 33674 11:36:51.582639 tst mo_mt_call.py: using BVCI 33675 11:36:51.703199 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:36:51.714809 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:36:51.726289 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:36:51.737657 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:36:51.749269 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:36:51.760912 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:36:51.878836 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:36:51.997162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:52.476919 run create_hlr_db(pid=14550): Launched 11:36:52.605297 bus /sierra_2: Setting Powered False 11:36:53.667144 run create_hlr_db(pid=14550): Terminated: ok {rc=0} 11:36:54.119936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14552): Launched 11:36:54.453433 run osmo-hlr_10.42.42.2(pid=14553): Launched 11:36:54.582699 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:55.158977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14555): Launched 11:36:55.490475 run osmo-stp_10.42.42.5(pid=14556): Launched 11:36:55.618769 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:56.218229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14558): Launched 11:36:56.549596 run osmo-msc_10.42.42.6(pid=14559): Launched 11:36:56.734528 run osmo-stp_10.42.42.5(pid=14556): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14556)] 11:36:56.874322 run osmo-stp_10.42.42.5(pid=14556): stdout: | (launched: 2022-12-13_11:36:55.429142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:57.015253 run osmo-stp_10.42.42.5(pid=14556): stderr: | 20221213113655623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113655624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113655624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113655624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113655627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113655627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113655627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:57.153883 run osmo-stp_10.42.42.5(pid=14556): stdout: | (launched: 2022-12-13_11:36:55.429142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:57.285956 run osmo-stp_10.42.42.5(pid=14556): stderr: | 20221213113655623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113655624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113655624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113655624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113655627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113655627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113655627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:57.443987 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14556): Process ended prematurely: osmo-stp_10.42.42.5(pid=14556) [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14556)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:36:57.453938 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:36:57.481695 run osmo-hlr_10.42.42.2(pid=14553): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14553)] 11:36:57.532416 run osmo-hlr_10.42.42.2(pid=14553): stdout: | (launched: 2022-12-13_11:36:54.391547) 11:36:57.584802 run osmo-hlr_10.42.42.2(pid=14553): stderr: | 20221213113654593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113654593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113654593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113654593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113654593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113654593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113654605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113654614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113654615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113654615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:57.657406 run osmo-msc_10.42.42.6(pid=14559): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14559)] 11:36:57.707449 run osmo-msc_10.42.42.6(pid=14559): stdout: | (launched: 2022-12-13_11:36:56.487967) 11:36:57.759183 run osmo-msc_10.42.42.6(pid=14559): stderr: | 20221213113656813 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113656813 DLGLOBAL DEBUG validating counter group 0x7fd755160c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113656813 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113656813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113656813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113656814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113656815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113656816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113656816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113656816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:57.812071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14552): Terminating (SIGTERM) 11:36:57.854057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14555): Terminating (SIGTERM) 11:36:57.896619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14558): Terminating (SIGTERM) 11:36:57.939179 --- ParallelTerminationStrategy: PID 14552 died... 11:36:57.959687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14552): Terminated: ok {rc=0} 11:36:58.006145 --- ParallelTerminationStrategy: PID 14555 died... 11:36:58.025976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14555): Terminated: ok {rc=0} 11:36:58.072720 --- ParallelTerminationStrategy: PID 14558 died... 11:36:58.092993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14558): Terminated: ok {rc=0} 11:36:58.181398 bus /sierra_3: Setting Powered False 11:36:59.282584 bus /sierra_3: Setting Powered False 11:37:00.402043 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:37:01.573146 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:01.588786 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:37:01.652331 tst mo_mt_call_osmux.py: using LAC 33675 11:37:01.776869 tst mo_mt_call_osmux.py: using RAC 15 11:37:01.911597 tst mo_mt_call_osmux.py: using CellId 33675 11:37:02.034999 tst mo_mt_call_osmux.py: using BVCI 33676 11:37:02.186228 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:02.199295 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:02.211934 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:02.224395 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:02.238088 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:02.252593 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:02.378625 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:02.498637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:03.017740 run create_hlr_db(pid=14561): Launched 11:37:03.144487 bus /sierra_2: Setting Powered False 11:37:04.209789 run create_hlr_db(pid=14561): Terminated: ok {rc=0} 11:37:04.674109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14563): Launched 11:37:05.007674 run osmo-hlr_10.42.42.2(pid=14564): Launched 11:37:05.136536 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:05.712843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14566): Launched 11:37:06.047927 run osmo-stp_10.42.42.5(pid=14567): Launched 11:37:06.176448 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:06.778084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14569): Launched 11:37:07.110573 run osmo-msc_10.42.42.6(pid=14570): Launched 11:37:07.296310 run osmo-stp_10.42.42.5(pid=14567): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14567)] 11:37:07.435949 run osmo-stp_10.42.42.5(pid=14567): stdout: | (launched: 2022-12-13_11:37:05.986336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:07.576361 run osmo-stp_10.42.42.5(pid=14567): stderr: | 20221213113706179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113706179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113706179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113706180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113706180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113706180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113706180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:07.715229 run osmo-stp_10.42.42.5(pid=14567): stdout: | (launched: 2022-12-13_11:37:05.986336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:07.847201 run osmo-stp_10.42.42.5(pid=14567): stderr: | 20221213113706179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113706179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113706179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113706180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113706180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113706180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113706180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:08.005382 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14567): Process ended prematurely: osmo-stp_10.42.42.5(pid=14567) [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14567)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:37:08.015090 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:37:08.042911 run osmo-hlr_10.42.42.2(pid=14564): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14564)] 11:37:08.093942 run osmo-hlr_10.42.42.2(pid=14564): stdout: | (launched: 2022-12-13_11:37:04.946126) 11:37:08.146549 run osmo-hlr_10.42.42.2(pid=14564): stderr: | 20221213113705147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113705147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113705147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113705147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113705147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113705147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113705159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113705167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113705168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113705168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:08.219384 run osmo-msc_10.42.42.6(pid=14570): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14570)] 11:37:08.269471 run osmo-msc_10.42.42.6(pid=14570): stdout: | (launched: 2022-12-13_11:37:07.049241) 11:37:08.321780 run osmo-msc_10.42.42.6(pid=14570): stderr: | 20221213113707375 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113707375 DLGLOBAL DEBUG validating counter group 0x7fafc6286c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113707375 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113707375 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113707375 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113707376 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113707377 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113707378 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113707378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113707378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:08.374438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14563): Terminating (SIGTERM) 11:37:08.416357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14566): Terminating (SIGTERM) 11:37:08.459046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14569): Terminating (SIGTERM) 11:37:08.501164 --- ParallelTerminationStrategy: PID 14563 died... 11:37:08.521627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14563): Terminated: ok {rc=0} 11:37:08.568571 --- ParallelTerminationStrategy: PID 14566 died... 11:37:08.588702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14566): Terminated: ok {rc=0} 11:37:08.635344 --- ParallelTerminationStrategy: PID 14569 died... 11:37:08.655298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14569): Terminated: ok {rc=0} 11:37:08.744330 bus /sierra_3: Setting Powered False 11:37:09.842044 bus /sierra_3: Setting Powered False 11:37:10.959184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:37:12.195205 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:12.201542 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:37:12.222520 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:37:12.249860 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:37:12.302259 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:37:12.324257 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:37:12.353088 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:37:12.902918 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:37:12.953386 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:12.964480 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:37:13.020872 tst mo_mt_call.py: using LAC 33676 11:37:13.143660 tst mo_mt_call.py: using RAC 16 11:37:13.266655 tst mo_mt_call.py: using CellId 33676 11:37:13.390435 tst mo_mt_call.py: using BVCI 33677 11:37:13.504294 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:13.515633 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:13.526637 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:13.537575 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:13.548588 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:13.559678 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:37:13.677299 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:37:13.800190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:14.315992 run create_hlr_db(pid=14575): Launched 11:37:14.444566 bus /sierra_2: Setting Powered False 11:37:15.510514 run create_hlr_db(pid=14575): Terminated: ok {rc=0} 11:37:15.973642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14577): Launched 11:37:16.339364 run osmo-hlr_10.42.42.2(pid=14578): Launched 11:37:16.585498 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:17.247889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14580): Launched 11:37:17.597933 run osmo-stp_10.42.42.5(pid=14581): Launched 11:37:17.725557 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:18.327757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14583): Launched 11:37:18.662337 run osmo-msc_10.42.42.6(pid=14584): Launched 11:37:18.848344 run osmo-stp_10.42.42.5(pid=14581): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14581)] 11:37:18.989102 run osmo-stp_10.42.42.5(pid=14581): stdout: | (launched: 2022-12-13_11:37:17.535729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:19.130724 run osmo-stp_10.42.42.5(pid=14581): stderr: | 20221213113717733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113717733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113717733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113717733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113717734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113717734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113717734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:19.269696 run osmo-stp_10.42.42.5(pid=14581): stdout: | (launched: 2022-12-13_11:37:17.535729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:19.402089 run osmo-stp_10.42.42.5(pid=14581): stderr: | 20221213113717733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113717733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113717733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113717733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113717734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113717734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113717734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:19.561063 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14581): Process ended prematurely: osmo-stp_10.42.42.5(pid=14581) [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14581)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:37:19.571053 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 11:37:19.598896 run osmo-hlr_10.42.42.2(pid=14578): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14578)] 11:37:19.650007 run osmo-hlr_10.42.42.2(pid=14578): stdout: | (launched: 2022-12-13_11:37:16.277653) 11:37:19.702427 run osmo-hlr_10.42.42.2(pid=14578): stderr: | 20221213113716528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113716528 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113716528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113716528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113716528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113716528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113716544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113716559 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113716560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113716560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:19.775917 run osmo-msc_10.42.42.6(pid=14584): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14584)] 11:37:19.826250 run osmo-msc_10.42.42.6(pid=14584): stdout: | (launched: 2022-12-13_11:37:18.600157) 11:37:19.879106 run osmo-msc_10.42.42.6(pid=14584): stderr: | 20221213113718924 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113718924 DLGLOBAL DEBUG validating counter group 0x7fa48b8f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113718925 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113718925 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113718925 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113718925 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113718927 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113718927 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113718927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113718927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:19.931675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14577): Terminating (SIGTERM) 11:37:19.974247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14580): Terminating (SIGTERM) 11:37:20.017672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14583): Terminating (SIGTERM) 11:37:20.060424 --- ParallelTerminationStrategy: PID 14577 died... 11:37:20.081080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14577): Terminated: ok {rc=0} 11:37:20.127875 --- ParallelTerminationStrategy: PID 14580 died... 11:37:20.147934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14580): Terminated: ok {rc=0} 11:37:20.194772 --- ParallelTerminationStrategy: PID 14583 died... 11:37:20.214912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14583): Terminated: ok {rc=0} 11:37:20.304830 bus /sierra_3: Setting Powered False 11:37:21.404500 bus /sierra_3: Setting Powered False 11:37:22.523750 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:37:23.674865 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:23.687238 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:37:23.745166 tst mo_mt_call_osmux.py: using LAC 33677 11:37:23.873082 tst mo_mt_call_osmux.py: using RAC 17 11:37:24.001343 tst mo_mt_call_osmux.py: using CellId 33677 11:37:24.129649 tst mo_mt_call_osmux.py: using BVCI 33678 11:37:24.243488 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:24.254890 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:24.266112 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:24.277155 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:24.288354 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:24.299717 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:37:24.420715 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:37:24.548378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:25.062467 run create_hlr_db(pid=14586): Launched 11:37:25.189579 bus /sierra_2: Setting Powered False 11:37:26.254803 run create_hlr_db(pid=14586): Terminated: ok {rc=0} 11:37:26.715389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14588): Launched 11:37:27.047448 run osmo-hlr_10.42.42.2(pid=14589): Launched 11:37:27.175151 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:27.750693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14591): Launched 11:37:28.084045 run osmo-stp_10.42.42.5(pid=14592): Launched 11:37:28.212388 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:28.812864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14594): Launched 11:37:29.146600 run osmo-msc_10.42.42.6(pid=14595): Launched 11:37:29.331318 run osmo-stp_10.42.42.5(pid=14592): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14592)] 11:37:29.470666 run osmo-stp_10.42.42.5(pid=14592): stdout: | (launched: 2022-12-13_11:37:28.022349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:29.611091 run osmo-stp_10.42.42.5(pid=14592): stderr: | 20221213113728216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113728216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113728216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113728217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113728219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113728219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113728219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:29.750210 run osmo-stp_10.42.42.5(pid=14592): stdout: | (launched: 2022-12-13_11:37:28.022349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:29.881853 run osmo-stp_10.42.42.5(pid=14592): stderr: | 20221213113728216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113728216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113728216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113728217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113728219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113728219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113728219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:30.040745 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14592): Process ended prematurely: osmo-stp_10.42.42.5(pid=14592) [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14592)] [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:37:30.050518 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:37:30.078293 run osmo-hlr_10.42.42.2(pid=14589): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14589)] 11:37:30.128935 run osmo-hlr_10.42.42.2(pid=14589): stdout: | (launched: 2022-12-13_11:37:26.986333) 11:37:30.180916 run osmo-hlr_10.42.42.2(pid=14589): stderr: | 20221213113727189 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113727189 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113727189 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113727189 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113727189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113727189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113727202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113727210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113727210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113727211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:30.253364 run osmo-msc_10.42.42.6(pid=14595): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14595)] 11:37:30.303108 run osmo-msc_10.42.42.6(pid=14595): stdout: | (launched: 2022-12-13_11:37:29.084914) 11:37:30.354988 run osmo-msc_10.42.42.6(pid=14595): stderr: | 20221213113729409 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113729409 DLGLOBAL DEBUG validating counter group 0x7f14a6ddac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113729409 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113729409 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113729410 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113729410 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113729411 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113729412 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113729412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113729412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:30.407494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14588): Terminating (SIGTERM) 11:37:30.449057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14591): Terminating (SIGTERM) 11:37:30.490803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14594): Terminating (SIGTERM) 11:37:30.532738 --- ParallelTerminationStrategy: PID 14588 died... 11:37:30.553170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14588): Terminated: ok {rc=0} 11:37:30.599918 --- ParallelTerminationStrategy: PID 14591 died... 11:37:30.619787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14591): Terminated: ok {rc=0} 11:37:30.666211 --- ParallelTerminationStrategy: PID 14594 died... 11:37:30.686021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14594): Terminated: ok {rc=0} 11:37:30.774391 bus /sierra_3: Setting Powered False 11:37:31.869908 bus /sierra_3: Setting Powered False 11:37:32.987509 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:37:34.223795 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:34.230179 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:37:34.251146 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:37:34.278149 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:37:34.331430 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:37:34.353200 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:37:34.381028 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:37:34.929532 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:37:34.978764 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:34.989965 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:37:35.046407 tst mo_mt_call.py: using LAC 33678 11:37:35.169691 tst mo_mt_call.py: using RAC 18 11:37:35.293447 tst mo_mt_call.py: using CellId 33678 11:37:35.416885 tst mo_mt_call.py: using BVCI 33679 11:37:35.530861 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:35.542051 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:35.553010 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:35.563961 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:35.574869 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:35.586042 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:37:35.706823 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:37:35.825031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:36.308003 run create_hlr_db(pid=14600): Launched 11:37:36.435956 bus /sierra_2: Setting Powered False 11:37:37.499709 run create_hlr_db(pid=14600): Terminated: ok {rc=0} 11:37:37.934168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14602): Launched 11:37:38.248455 run osmo-hlr_10.42.42.2(pid=14603): Launched 11:37:38.366820 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:38.902609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14605): Launched 11:37:39.215313 run osmo-stp_10.42.42.5(pid=14606): Launched 11:37:39.333902 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:39.894993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14608): Launched 11:37:40.208297 run osmo-msc_10.42.42.6(pid=14609): Launched 11:37:40.381196 run osmo-stp_10.42.42.5(pid=14606): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14606)] 11:37:40.512507 run osmo-stp_10.42.42.5(pid=14606): stdout: | (launched: 2022-12-13_11:37:39.157442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:40.642944 run osmo-stp_10.42.42.5(pid=14606): stderr: | 20221213113739332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113739332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113739332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113739333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113739333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113739334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113739334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:40.772210 run osmo-stp_10.42.42.5(pid=14606): stdout: | (launched: 2022-12-13_11:37:39.157442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:40.895491 run osmo-stp_10.42.42.5(pid=14606): stderr: | 20221213113739332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113739332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113739332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113739333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113739333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113739334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113739334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:41.043269 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14606): Process ended prematurely: osmo-stp_10.42.42.5(pid=14606) [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14606)] [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:37:41.052258 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:37:41.078645 run osmo-hlr_10.42.42.2(pid=14603): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14603)] 11:37:41.126545 run osmo-hlr_10.42.42.2(pid=14603): stdout: | (launched: 2022-12-13_11:37:38.190559) 11:37:41.176229 run osmo-hlr_10.42.42.2(pid=14603): stderr: | 20221213113738372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113738372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113738372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113738372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113738372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113738372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113738384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113738393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113738393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113738393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:41.245486 run osmo-msc_10.42.42.6(pid=14609): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14609)] 11:37:41.293275 run osmo-msc_10.42.42.6(pid=14609): stdout: | (launched: 2022-12-13_11:37:40.149918) 11:37:41.342731 run osmo-msc_10.42.42.6(pid=14609): stderr: | 20221213113740427 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113740427 DLGLOBAL DEBUG validating counter group 0x7f2941af2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113740427 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113740427 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113740427 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113740428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113740429 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113740430 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113740430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113740430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:41.392384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14602): Terminating (SIGTERM) 11:37:41.432258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14605): Terminating (SIGTERM) 11:37:41.472114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14608): Terminating (SIGTERM) 11:37:41.512074 --- ParallelTerminationStrategy: PID 14602 died... 11:37:41.531390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14602): Terminated: ok {rc=0} 11:37:41.575467 --- ParallelTerminationStrategy: PID 14605 died... 11:37:41.594333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14605): Terminated: ok {rc=0} 11:37:41.638682 --- ParallelTerminationStrategy: PID 14608 died... 11:37:41.657413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14608): Terminated: ok {rc=0} 11:37:41.743912 bus /sierra_3: Setting Powered False 11:37:42.843408 bus /sierra_3: Setting Powered False 11:37:43.960000 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:37:45.106422 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:45.118392 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:37:45.176411 tst mo_mt_call_osmux.py: using LAC 33679 11:37:45.300699 tst mo_mt_call_osmux.py: using RAC 19 11:37:45.423211 tst mo_mt_call_osmux.py: using CellId 33679 11:37:45.547528 tst mo_mt_call_osmux.py: using BVCI 33680 11:37:45.662211 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:45.673659 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:45.684603 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:45.695684 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:45.706749 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:37:45.717967 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:37:45.833766 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:37:45.954115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:46.449019 run create_hlr_db(pid=14611): Launched 11:37:46.607429 bus /sierra_2: Setting Powered False 11:37:47.668880 run create_hlr_db(pid=14611): Terminated: ok {rc=0} 11:37:48.123071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14613): Launched 11:37:48.456938 run osmo-hlr_10.42.42.2(pid=14614): Launched 11:37:48.586061 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:49.161806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14616): Launched 11:37:49.496130 run osmo-stp_10.42.42.5(pid=14617): Launched 11:37:49.623303 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:50.225714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14619): Launched 11:37:50.560454 run osmo-msc_10.42.42.6(pid=14620): Launched 11:37:50.748362 run osmo-stp_10.42.42.5(pid=14617): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14617)] 11:37:50.888021 run osmo-stp_10.42.42.5(pid=14617): stdout: | (launched: 2022-12-13_11:37:49.434476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:51.029267 run osmo-stp_10.42.42.5(pid=14617): stderr: | 20221213113749628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113749628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113749628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113749628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113749629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113749629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113749629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:51.167555 run osmo-stp_10.42.42.5(pid=14617): stdout: | (launched: 2022-12-13_11:37:49.434476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:51.299638 run osmo-stp_10.42.42.5(pid=14617): stderr: | 20221213113749628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113749628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113749628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113749628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113749629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113749629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113749629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:51.457115 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14617): Process ended prematurely: osmo-stp_10.42.42.5(pid=14617) [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14617)] [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:37:51.466861 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:37:51.494584 run osmo-hlr_10.42.42.2(pid=14614): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14614)] 11:37:51.545173 run osmo-hlr_10.42.42.2(pid=14614): stdout: | (launched: 2022-12-13_11:37:48.395531) 11:37:51.597494 run osmo-hlr_10.42.42.2(pid=14614): stderr: | 20221213113748596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113748596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113748596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113748596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113748596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113748596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113748608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113748617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113748617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113748617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:51.670916 run osmo-msc_10.42.42.6(pid=14620): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14620)] 11:37:51.721408 run osmo-msc_10.42.42.6(pid=14620): stdout: | (launched: 2022-12-13_11:37:50.499075) 11:37:51.773711 run osmo-msc_10.42.42.6(pid=14620): stderr: | 20221213113750821 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113750821 DLGLOBAL DEBUG validating counter group 0x7f79e1e0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113750822 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113750822 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113750822 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113750822 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113750824 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113750824 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113750824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113750824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:51.825775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14613): Terminating (SIGTERM) 11:37:51.867879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14616): Terminating (SIGTERM) 11:37:51.910564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14619): Terminating (SIGTERM) 11:37:51.953393 --- ParallelTerminationStrategy: PID 14613 died... 11:37:51.973779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14613): Terminated: ok {rc=0} 11:37:52.020313 --- ParallelTerminationStrategy: PID 14616 died... 11:37:52.040061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14616): Terminated: ok {rc=0} 11:37:52.086565 --- ParallelTerminationStrategy: PID 14619 died... 11:37:52.106357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14619): Terminated: ok {rc=0} 11:37:52.194655 bus /sierra_3: Setting Powered False 11:37:53.291400 bus /sierra_3: Setting Powered False 11:37:54.408095 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:37:55.644195 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:55.649647 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:37:55.670664 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:37:55.698408 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:37:55.752376 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:37:55.774286 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:37:55.802196 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:37:56.347770 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:37:56.397407 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:37:56.408294 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:37:56.465129 tst mo_mt_call.py: using LAC 33680 11:37:56.596012 tst mo_mt_call.py: using RAC 20 11:37:56.726560 tst mo_mt_call.py: using CellId 33680 11:37:56.860746 tst mo_mt_call.py: using BVCI 33681 11:37:56.981919 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:37:56.993657 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:37:57.004751 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:37:57.015970 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:37:57.027504 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:37:57.039153 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:37:57.158066 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:37:57.283329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:57.800460 run create_hlr_db(pid=14626): Launched 11:37:57.928392 bus /sierra_2: Setting Powered False 11:37:58.993692 run create_hlr_db(pid=14626): Terminated: ok {rc=0} 11:37:59.438398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14628): Launched 11:37:59.750624 run osmo-hlr_10.42.42.2(pid=14629): Launched 11:37:59.868370 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:00.405722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14631): Launched 11:38:00.720025 run osmo-stp_10.42.42.5(pid=14632): Launched 11:38:00.838634 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:01.430291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14634): Launched 11:38:01.759276 run osmo-msc_10.42.42.6(pid=14635): Launched 11:38:02.036395 run osmo-stp_10.42.42.5(pid=14632): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14632)] 11:38:02.257603 run osmo-stp_10.42.42.5(pid=14632): stdout: | (launched: 2022-12-13_11:38:00.661773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:02.490941 run osmo-stp_10.42.42.5(pid=14632): stderr: | 20221213113800837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113800837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113800837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113800838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113800838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113800838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113800838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:02.625497 run osmo-stp_10.42.42.5(pid=14632): stdout: | (launched: 2022-12-13_11:38:00.661773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:02.748596 run osmo-stp_10.42.42.5(pid=14632): stderr: | 20221213113800837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113800837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113800837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113800838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113800838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113800838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113800838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:02.896254 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14632): Process ended prematurely: osmo-stp_10.42.42.5(pid=14632) [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14632)] [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:38:02.905476 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:38:02.931920 run osmo-hlr_10.42.42.2(pid=14629): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14629)] 11:38:02.979813 run osmo-hlr_10.42.42.2(pid=14629): stdout: | (launched: 2022-12-13_11:37:59.692825) 11:38:03.029485 run osmo-hlr_10.42.42.2(pid=14629): stderr: | 20221213113759872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113759872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113759872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113759872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113759872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113759872 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113759884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113759893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113759894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113759894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:03.099130 run osmo-msc_10.42.42.6(pid=14635): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14635)] 11:38:03.147096 run osmo-msc_10.42.42.6(pid=14635): stdout: | (launched: 2022-12-13_11:38:01.700386) 11:38:03.197350 run osmo-msc_10.42.42.6(pid=14635): stderr: | 20221213113802299 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113802300 DLGLOBAL DEBUG validating counter group 0x7f7990913c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113802300 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113802301 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113802301 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113802301 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113802305 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113802307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113802307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113802307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:03.247412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14628): Terminating (SIGTERM) 11:38:03.287948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14631): Terminating (SIGTERM) 11:38:03.328225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14634): Terminating (SIGTERM) 11:38:03.368654 --- ParallelTerminationStrategy: PID 14628 died... 11:38:03.388182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14628): Terminated: ok {rc=0} 11:38:03.433143 --- ParallelTerminationStrategy: PID 14631 died... 11:38:03.451748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14631): Terminated: ok {rc=0} 11:38:03.496060 --- ParallelTerminationStrategy: PID 14634 died... 11:38:03.514820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14634): Terminated: ok {rc=0} 11:38:03.601263 bus /sierra_3: Setting Powered False 11:38:04.700558 bus /sierra_3: Setting Powered False 11:38:05.813609 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:38:06.963729 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:06.975837 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:38:07.035419 tst mo_mt_call_osmux.py: using LAC 33681 11:38:07.158464 tst mo_mt_call_osmux.py: using RAC 21 11:38:07.281097 tst mo_mt_call_osmux.py: using CellId 33681 11:38:07.404855 tst mo_mt_call_osmux.py: using BVCI 33682 11:38:07.518290 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:07.529369 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:07.540331 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:07.551051 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:07.561831 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:07.573137 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:38:07.694263 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:38:07.813111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:08.294846 run create_hlr_db(pid=14637): Launched 11:38:08.422405 bus /sierra_2: Setting Powered False 11:38:09.483761 run create_hlr_db(pid=14637): Terminated: ok {rc=0} 11:38:09.938704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14639): Launched 11:38:10.271368 run osmo-hlr_10.42.42.2(pid=14640): Launched 11:38:10.400091 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:10.973687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14642): Launched 11:38:11.307542 run osmo-stp_10.42.42.5(pid=14643): Launched 11:38:11.443080 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:12.044053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14645): Launched 11:38:12.378329 run osmo-msc_10.42.42.6(pid=14646): Launched 11:38:12.564434 run osmo-stp_10.42.42.5(pid=14643): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14643)] 11:38:12.704294 run osmo-stp_10.42.42.5(pid=14643): stdout: | (launched: 2022-12-13_11:38:11.246148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:12.844424 run osmo-stp_10.42.42.5(pid=14643): stderr: | 20221213113811442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113811442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113811442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113811443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113811443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113811443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113811443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:12.983333 run osmo-stp_10.42.42.5(pid=14643): stdout: | (launched: 2022-12-13_11:38:11.246148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:13.114950 run osmo-stp_10.42.42.5(pid=14643): stderr: | 20221213113811442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113811442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113811442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113811443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113811443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113811443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113811443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:13.273084 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14643): Process ended prematurely: osmo-stp_10.42.42.5(pid=14643) [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14643)] [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:38:13.282970 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:38:13.310776 run osmo-hlr_10.42.42.2(pid=14640): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14640)] 11:38:13.362199 run osmo-hlr_10.42.42.2(pid=14640): stdout: | (launched: 2022-12-13_11:38:10.209998) 11:38:13.414700 run osmo-hlr_10.42.42.2(pid=14640): stderr: | 20221213113810410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113810410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113810410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113810410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113810411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113810411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113810423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113810432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113810432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113810432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:13.487783 run osmo-msc_10.42.42.6(pid=14646): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14646)] 11:38:13.537746 run osmo-msc_10.42.42.6(pid=14646): stdout: | (launched: 2022-12-13_11:38:12.315971) 11:38:13.589583 run osmo-msc_10.42.42.6(pid=14646): stderr: | 20221213113812642 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113812642 DLGLOBAL DEBUG validating counter group 0x7f22b6b34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113812642 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113812642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113812642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113812642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113812644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113812644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113812645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113812645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:13.642165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14639): Terminating (SIGTERM) 11:38:13.684124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14642): Terminating (SIGTERM) 11:38:13.726024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14645): Terminating (SIGTERM) 11:38:13.768532 --- ParallelTerminationStrategy: PID 14639 died... 11:38:13.788861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14639): Terminated: ok {rc=0} 11:38:13.835503 --- ParallelTerminationStrategy: PID 14642 died... 11:38:13.855524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14642): Terminated: ok {rc=0} 11:38:13.901784 --- ParallelTerminationStrategy: PID 14645 died... 11:38:13.921663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14645): Terminated: ok {rc=0} 11:38:14.011092 bus /sierra_3: Setting Powered False 11:38:15.110424 bus /sierra_3: Setting Powered False 11:38:16.238549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 emergency:sysmo --------------------------------------------------------------------- 11:38:17.480736 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:38:17.486104 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 11:38:17.508198 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 11:38:17.537639 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 11:38:17.625881 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 11:38:17.647558 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 11:38:17.675523 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 11:38:18.261583 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2389 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 11:38:18.266747 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:18.277947 tst emergency:sysmo: Using 1 x bts (candidates: 1) 11:38:18.318219 tst emergency_mo_mt_call.py: using LAC 33682 11:38:18.439723 tst emergency_mo_mt_call.py: using RAC 22 11:38:18.558146 tst emergency_mo_mt_call.py: using CellId 33682 11:38:18.690927 tst emergency_mo_mt_call.py: using BVCI 33683 11:38:18.810300 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:18.821409 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:18.832403 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:18.843396 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:18.854763 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:18.866075 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:38:18.984077 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:38:19.104386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:19.612285 run create_hlr_db(pid=14651): Launched 11:38:19.738450 bus /sierra_2: Setting Powered False 11:38:20.802888 run create_hlr_db(pid=14651): Terminated: ok {rc=0} 11:38:21.241517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14653): Launched 11:38:21.553150 run osmo-hlr_10.42.42.2(pid=14654): Launched 11:38:21.672293 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:22.199372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14656): Launched 11:38:22.507070 run osmo-stp_10.42.42.5(pid=14657): Launched 11:38:22.649984 tst emergency_mo_mt_call.py: using MSISDN 8140 11:38:22.805939 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:23.355611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14659): Launched 11:38:23.665780 run osmo-msc_10.42.42.6(pid=14660): Launched 11:38:23.836122 run osmo-stp_10.42.42.5(pid=14657): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14657)] 11:38:23.965116 run osmo-stp_10.42.42.5(pid=14657): stdout: | (launched: 2022-12-13_11:38:22.449242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:24.093569 run osmo-stp_10.42.42.5(pid=14657): stderr: | 20221213113822621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113822622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113822622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113822622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113822623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113822623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113822623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:24.220252 run osmo-stp_10.42.42.5(pid=14657): stdout: | (launched: 2022-12-13_11:38:22.449242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:24.341927 run osmo-stp_10.42.42.5(pid=14657): stderr: | 20221213113822621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113822622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113822622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113822622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113822623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113822623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113822623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:24.486936 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14657): Process ended prematurely: osmo-stp_10.42.42.5(pid=14657) [trial-2389↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14657)] [trial-2389↪emergency:sysmo↪emergency_mo_mt_call.py:19] 11:38:24.495712 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 11:38:24.522278 run osmo-hlr_10.42.42.2(pid=14654): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14654)] 11:38:24.571004 run osmo-hlr_10.42.42.2(pid=14654): stdout: | (launched: 2022-12-13_11:38:21.495372) 11:38:24.621209 run osmo-hlr_10.42.42.2(pid=14654): stderr: | 20221213113821683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113821683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113821684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113821684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113821684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113821684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113821699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113821708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113821709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113821709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:24.690780 run osmo-msc_10.42.42.6(pid=14660): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14660)] 11:38:24.738648 run osmo-msc_10.42.42.6(pid=14660): stdout: | (launched: 2022-12-13_11:38:23.604768) 11:38:24.788215 run osmo-msc_10.42.42.6(pid=14660): stderr: | 20221213113823880 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113823880 DLGLOBAL DEBUG validating counter group 0x7fcb7780cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113823880 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113823880 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113823880 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113823880 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113823882 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113823883 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113823883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113823883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:24.838386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14653): Terminating (SIGTERM) 11:38:24.878346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14656): Terminating (SIGTERM) 11:38:24.918758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14659): Terminating (SIGTERM) 11:38:24.959749 --- ParallelTerminationStrategy: PID 14653 died... 11:38:24.979513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14653): Terminated: ok {rc=0} 11:38:25.024421 --- ParallelTerminationStrategy: PID 14656 died... 11:38:25.043716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14656): Terminated: ok {rc=0} 11:38:25.088559 --- ParallelTerminationStrategy: PID 14659 died... 11:38:25.107798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14659): Terminated: ok {rc=0} 11:38:25.195273 bus /sierra_3: Setting Powered False 11:38:26.295282 bus /sierra_3: Setting Powered False 11:38:27.411835 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 11:38:28.501506 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:28.513164 tst emergency:sysmo: Using 1 x bts (candidates: 1) 11:38:28.551465 tst emergency_preemptive_call.py: using LAC 33683 11:38:28.673609 tst emergency_preemptive_call.py: using RAC 23 11:38:28.793458 tst emergency_preemptive_call.py: using CellId 33683 11:38:28.914280 tst emergency_preemptive_call.py: using BVCI 33684 11:38:29.027223 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:29.038026 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:29.048632 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:29.059166 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:29.070252 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:38:29.081428 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:38:29.202606 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:38:29.323320 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:38:29.439804 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:38:29.556177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:30.032465 run create_hlr_db(pid=14662): Launched 11:38:30.156570 bus /sierra_2: Setting Powered False 11:38:31.219812 run create_hlr_db(pid=14662): Terminated: ok {rc=0} 11:38:31.707573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14664): Launched 11:38:32.037506 run osmo-hlr_10.42.42.2(pid=14665): Launched 11:38:32.283052 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:32.850403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14667): Launched 11:38:33.179111 run osmo-stp_10.42.42.5(pid=14668): Launched 11:38:33.313841 tst emergency_preemptive_call.py: using MSISDN 8141 11:38:33.483478 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:34.068560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14670): Launched 11:38:34.396056 run osmo-msc_10.42.42.6(pid=14671): Launched 11:38:34.584497 run osmo-stp_10.42.42.5(pid=14668): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14668)] 11:38:34.722331 run osmo-stp_10.42.42.5(pid=14668): stdout: | (launched: 2022-12-13_11:38:33.117948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:34.860025 run osmo-stp_10.42.42.5(pid=14668): stderr: | 20221213113833316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113833316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113833317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113833317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113833318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113833318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113833318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:34.997396 run osmo-stp_10.42.42.5(pid=14668): stdout: | (launched: 2022-12-13_11:38:33.117948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:35.127357 run osmo-stp_10.42.42.5(pid=14668): stderr: | 20221213113833316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113833316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113833317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113833317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113833318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113833318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113833318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:35.282934 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14668): Process ended prematurely: osmo-stp_10.42.42.5(pid=14668) [trial-2389↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14668)] [trial-2389↪emergency:sysmo↪emergency_preemptive_call.py:32] 11:38:35.292010 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 11:38:35.319437 run osmo-hlr_10.42.42.2(pid=14665): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14665)] 11:38:35.370099 run osmo-hlr_10.42.42.2(pid=14665): stdout: | (launched: 2022-12-13_11:38:31.974783) 11:38:35.421884 run osmo-hlr_10.42.42.2(pid=14665): stderr: | 20221213113832259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113832259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113832259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113832259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113832259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113832259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113832272 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113832282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113832282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113832282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:35.494297 run osmo-msc_10.42.42.6(pid=14671): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14671)] 11:38:35.544098 run osmo-msc_10.42.42.6(pid=14671): stdout: | (launched: 2022-12-13_11:38:34.334737) 11:38:35.596140 run osmo-msc_10.42.42.6(pid=14671): stderr: | 20221213113834661 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213113834661 DLGLOBAL DEBUG validating counter group 0x7f445fa34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213113834661 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213113834661 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213113834661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213113834661 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213113834664 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213113834664 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213113834664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213113834664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:35.649112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14664): Terminating (SIGTERM) 11:38:35.691002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14667): Terminating (SIGTERM) 11:38:35.732651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14670): Terminating (SIGTERM) 11:38:35.774890 --- ParallelTerminationStrategy: PID 14664 died... 11:38:35.795289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14664): Terminated: ok {rc=0} 11:38:35.841893 --- ParallelTerminationStrategy: PID 14667 died... 11:38:35.861868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14667): Terminated: ok {rc=0} 11:38:35.908320 --- ParallelTerminationStrategy: PID 14670 died... 11:38:35.928307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14670): Terminated: ok {rc=0} 11:38:36.016366 bus /sierra_9: Setting Powered False 11:38:37.115553 bus /sierra_9: Setting Powered False 11:38:38.231481 bus /sierra_8: Setting Powered False 11:38:39.329831 bus /sierra_8: Setting Powered False 11:38:40.446260 bus /sierra_3: Setting Powered False 11:38:41.545253 bus /sierra_3: Setting Powered False 11:38:42.662084 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:sysmo --------------------------------------------------------------------- 11:38:43.928536 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:38:43.933147 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 11:38:43.954755 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 11:38:43.995485 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 11:38:44.088215 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 11:38:44.109285 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 11:38:44.147572 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 11:38:44.740338 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 11:38:44.796049 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:38:44.807147 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:38:44.843967 tst cs_paging_gprs_active.py: using LAC 33684 11:38:44.967158 tst cs_paging_gprs_active.py: using RAC 24 11:38:45.091311 tst cs_paging_gprs_active.py: using CellId 33684 11:38:45.213857 tst cs_paging_gprs_active.py: using BVCI 33685 11:38:45.326541 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:38:45.337330 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:38:45.347948 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:38:45.358457 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:38:45.368785 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:38:45.379925 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:38:45.391120 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:38:45.401703 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:38:45.412476 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:38:45.533101 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:38:45.652917 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:38:45.863290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:38:46.229927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14676): Launched 11:38:46.527403 run iperf3-srv_10.42.42.10(pid=14677): Launched 11:38:46.656928 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:38:46.881062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:38:47.252235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14706): Launched 11:38:47.570467 run iperf3-srv_10.42.42.10(pid=14715): Launched 11:38:47.702313 tst cs_paging_gprs_active.py:38: start network... 11:38:47.951360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:48.528543 run create_hlr_db(pid=14767): Launched 11:38:48.729291 bus /sierra_2: Setting Powered False 11:38:49.795159 run create_hlr_db(pid=14767): Terminated: ok {rc=0} 11:38:50.297826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14952): Launched 11:38:50.655041 run osmo-hlr_10.42.42.2(pid=14953): Launched 11:38:50.912931 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:51.600704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14957): Launched 11:38:51.932196 run osmo-stp_10.42.42.5(pid=14958): Launched 11:38:52.193992 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:38:53.879116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14960): Launched 11:38:54.021170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:38:54.313531 run patchelf(pid=14961): Launched 11:38:54.531024 run osmo-stp_10.42.42.5(pid=14958): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14958)] 11:38:54.679147 run osmo-stp_10.42.42.5(pid=14958): stdout: | (launched: 2022-12-13_11:38:51.868471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:54.827553 run osmo-stp_10.42.42.5(pid=14958): stderr: | 20221213113852164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113852164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113852164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113852165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113852165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113852165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113852166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:54.976706 run osmo-stp_10.42.42.5(pid=14958): stdout: | (launched: 2022-12-13_11:38:51.868471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:55.118999 run osmo-stp_10.42.42.5(pid=14958): stderr: | 20221213113852164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113852164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113852164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113852165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113852165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113852165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113852166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:55.287941 run patchelf(pid=14961): Terminating (SIGINT) 11:38:55.482362 run patchelf(pid=14961): Terminated: ok {rc=0} 11:38:55.622796 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14958): Process ended prematurely: osmo-stp_10.42.42.5(pid=14958) [trial-2389↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14958)] [trial-2389↪gprs:sysmo↪cs_paging_gprs_active.py:38] 11:38:55.634453 tst cs_paging_gprs_active.py:38: Test FAILED (10.9 sec) 11:38:55.666161 run osmo-hlr_10.42.42.2(pid=14953): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14953)] 11:38:55.722083 run osmo-hlr_10.42.42.2(pid=14953): stdout: | (launched: 2022-12-13_11:38:50.589831) 11:38:55.777610 run osmo-hlr_10.42.42.2(pid=14953): stderr: | 20221213113850899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113850899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113850899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113850899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113850900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113850900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113850920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113850933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113850933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113850933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:55.834278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14676): Terminating (SIGTERM) 11:38:55.879847 run iperf3-srv_10.42.42.10(pid=14677): Terminating (SIGTERM) 11:38:55.933617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14706): Terminating (SIGTERM) 11:38:55.978519 run iperf3-srv_10.42.42.10(pid=14715): Terminating (SIGTERM) 11:38:56.026559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14952): Terminating (SIGTERM) 11:38:56.073444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14957): Terminating (SIGTERM) 11:38:56.120220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14960): Terminating (SIGTERM) 11:38:56.167673 --- ParallelTerminationStrategy: PID 14676 died... 11:38:56.190160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14676): Terminated: ok {rc=0} 11:38:56.241195 --- ParallelTerminationStrategy: PID 14677 died... 11:38:56.263787 run iperf3-srv_10.42.42.10(pid=14677): Terminated {rc=256} 11:38:56.313534 --- ParallelTerminationStrategy: PID 14706 died... 11:38:56.335825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14706): Terminated: ok {rc=0} 11:38:56.385389 --- ParallelTerminationStrategy: PID 14715 died... 11:38:56.407205 run iperf3-srv_10.42.42.10(pid=14715): Terminated {rc=256} 11:38:56.456789 --- ParallelTerminationStrategy: PID 14952 died... 11:38:56.479742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14952): Terminated: ok {rc=0} 11:38:56.529085 --- ParallelTerminationStrategy: PID 14957 died... 11:38:56.551310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14957): Terminated: ok {rc=0} 11:38:56.601539 --- ParallelTerminationStrategy: PID 14960 died... 11:38:56.623945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14960): Terminated: ok {rc=0} 11:38:56.719370 bus /gobi_0: Setting Powered False 11:38:57.822949 bus /gobi_0: Setting Powered False 11:38:58.947641 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo iperf3.py ---------------------------------------------- 11:39:00.108365 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:00.121384 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:39:00.158848 tst iperf3.py: using LAC 33685 11:39:00.297383 tst iperf3.py: using RAC 25 11:39:00.432589 tst iperf3.py: using CellId 33685 11:39:00.568289 tst iperf3.py: using BVCI 33686 11:39:00.697245 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:00.709864 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:00.722080 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:00.734265 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:00.747582 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:00.760769 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:00.774259 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:00.787467 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:00.800369 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:39:00.969545 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:39:01.227567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:01.575267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14962): Launched 11:39:01.887328 run iperf3-srv_10.42.42.10(pid=14963): Launched 11:39:02.029842 tst iperf3.py:8: start network... 11:39:02.265113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:02.800870 run create_hlr_db(pid=14964): Launched 11:39:02.969926 bus /gobi_6: Setting Powered False 11:39:04.036136 run create_hlr_db(pid=14964): Terminated: ok {rc=0} 11:39:04.517589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14966): Launched 11:39:04.875311 run osmo-hlr_10.42.42.2(pid=14967): Launched 11:39:05.134459 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:05.827126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14969): Launched 11:39:06.184089 run osmo-stp_10.42.42.5(pid=14970): Launched 11:39:06.436821 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:07.114107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14972): Launched 11:39:07.257869 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:07.553918 run patchelf(pid=14973): Launched 11:39:07.762035 run osmo-stp_10.42.42.5(pid=14970): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14970)] 11:39:07.909411 run osmo-stp_10.42.42.5(pid=14970): stdout: | (launched: 2022-12-13_11:39:06.121226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:08.058529 run osmo-stp_10.42.42.5(pid=14970): stderr: | 20221213113906426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113906426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113906426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113906427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113906427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113906427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113906427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:08.207105 run osmo-stp_10.42.42.5(pid=14970): stdout: | (launched: 2022-12-13_11:39:06.121226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:08.350161 run osmo-stp_10.42.42.5(pid=14970): stderr: | 20221213113906426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113906426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113906426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113906427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113906427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113906427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113906427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:08.519065 run patchelf(pid=14973): Terminating (SIGINT) 11:39:08.715694 run patchelf(pid=14973): Terminated: ok {rc=0} 11:39:08.856000 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14970): Process ended prematurely: osmo-stp_10.42.42.5(pid=14970) [trial-2389↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14970)] [trial-2389↪gprs:sysmo↪iperf3.py:8] 11:39:08.868824 tst iperf3.py:8: Test FAILED (8.8 sec) 11:39:08.899244 run osmo-hlr_10.42.42.2(pid=14967): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14967)] 11:39:08.956585 run osmo-hlr_10.42.42.2(pid=14967): stdout: | (launched: 2022-12-13_11:39:04.811667) 11:39:09.012777 run osmo-hlr_10.42.42.2(pid=14967): stderr: | 20221213113905121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113905121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113905121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113905121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113905121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113905121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113905141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113905154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113905154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113905154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:09.070384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14962): Terminating (SIGTERM) 11:39:09.115222 run iperf3-srv_10.42.42.10(pid=14963): Terminating (SIGTERM) 11:39:09.163638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14966): Terminating (SIGTERM) 11:39:09.209758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14969): Terminating (SIGTERM) 11:39:09.257813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14972): Terminating (SIGTERM) 11:39:09.305937 --- ParallelTerminationStrategy: PID 14962 died... 11:39:09.329077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14962): Terminated: ok {rc=0} 11:39:09.381837 --- ParallelTerminationStrategy: PID 14963 died... 11:39:09.403120 run iperf3-srv_10.42.42.10(pid=14963): Terminated {rc=256} 11:39:09.453260 --- ParallelTerminationStrategy: PID 14966 died... 11:39:09.476340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14966): Terminated: ok {rc=0} 11:39:09.527416 --- ParallelTerminationStrategy: PID 14969 died... 11:39:09.549402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14969): Terminated: ok {rc=0} 11:39:09.600769 --- ParallelTerminationStrategy: PID 14972 died... 11:39:09.623062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14972): Terminated: ok {rc=0} 11:39:09.719798 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo iperf3m4.py ---------------------------------------------- 11:39:10.872208 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:10.883861 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:39:10.921102 tst iperf3m4.py: using LAC 33686 11:39:11.054285 tst iperf3m4.py: using RAC 26 11:39:11.186335 tst iperf3m4.py: using CellId 33686 11:39:11.318321 tst iperf3m4.py: using BVCI 33687 11:39:11.441819 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:11.453153 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:11.464369 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:11.475378 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:11.486580 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:11.497833 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:11.509370 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:11.520497 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:11.531891 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:39:11.654477 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:39:11.776017 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:39:11.897746 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:39:12.016697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:39:12.226975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:12.543447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14974): Launched 11:39:12.818933 run iperf3-srv_10.42.42.10(pid=14975): Launched 11:39:12.937999 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:39:13.147949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:13.463140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14976): Launched 11:39:13.737906 run iperf3-srv_10.42.42.10(pid=14977): Launched 11:39:13.856493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:39:14.066721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:14.383406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14978): Launched 11:39:14.657644 run iperf3-srv_10.42.42.10(pid=14979): Launched 11:39:14.775878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:39:14.986492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:15.301521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14980): Launched 11:39:15.591052 run iperf3-srv_10.42.42.10(pid=14981): Launched 11:39:15.718875 tst iperf3m4.py:8: start network... 11:39:15.956401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:16.546975 run create_hlr_db(pid=14982): Launched 11:39:16.698350 bus /gobi_6: Setting Powered False 11:39:17.759936 run create_hlr_db(pid=14982): Terminated: ok {rc=0} 11:39:18.195694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14984): Launched 11:39:18.509656 run osmo-hlr_10.42.42.2(pid=14985): Launched 11:39:18.628557 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:19.184345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14987): Launched 11:39:19.498466 run osmo-stp_10.42.42.5(pid=14988): Launched 11:39:19.617778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:20.152342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14990): Launched 11:39:20.272505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:20.536904 run patchelf(pid=14991): Launched 11:39:20.711077 run osmo-stp_10.42.42.5(pid=14988): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14988)] 11:39:20.842829 run osmo-stp_10.42.42.5(pid=14988): stdout: | (launched: 2022-12-13_11:39:19.439411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:20.976371 run osmo-stp_10.42.42.5(pid=14988): stderr: | 20221213113919613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113919613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113919614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113919614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113919615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113919615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113919615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:21.111078 run osmo-stp_10.42.42.5(pid=14988): stdout: | (launched: 2022-12-13_11:39:19.439411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:21.237860 run osmo-stp_10.42.42.5(pid=14988): stderr: | 20221213113919613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113919613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113919614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113919614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113919615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113919615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113919615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:21.387836 run patchelf(pid=14991): Terminating (SIGINT) 11:39:21.561589 run patchelf(pid=14991): Terminated: ok {rc=0} 11:39:21.686762 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14988): Process ended prematurely: osmo-stp_10.42.42.5(pid=14988) [trial-2389↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14988)] [trial-2389↪gprs:sysmo↪iperf3m4.py:8] 11:39:21.696328 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:39:21.724053 run osmo-hlr_10.42.42.2(pid=14985): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14985)] 11:39:21.772524 run osmo-hlr_10.42.42.2(pid=14985): stdout: | (launched: 2022-12-13_11:39:18.450795) 11:39:21.822582 run osmo-hlr_10.42.42.2(pid=14985): stderr: | 20221213113918635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113918635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113918635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113918635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113918635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113918636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113918648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113918659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113918659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113918659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:21.873169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14974): Terminating (SIGTERM) 11:39:21.913395 run iperf3-srv_10.42.42.10(pid=14975): Terminating (SIGTERM) 11:39:21.953508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14976): Terminating (SIGTERM) 11:39:21.993567 run iperf3-srv_10.42.42.10(pid=14977): Terminating (SIGTERM) 11:39:22.033399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14978): Terminating (SIGTERM) 11:39:22.073475 run iperf3-srv_10.42.42.10(pid=14979): Terminating (SIGTERM) 11:39:22.113672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14980): Terminating (SIGTERM) 11:39:22.153673 run iperf3-srv_10.42.42.10(pid=14981): Terminating (SIGTERM) 11:39:22.193475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14984): Terminating (SIGTERM) 11:39:22.233662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14987): Terminating (SIGTERM) 11:39:22.273684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14990): Terminating (SIGTERM) 11:39:22.313851 --- ParallelTerminationStrategy: PID 14974 died... 11:39:22.333232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14974): Terminated: ok {rc=0} 11:39:22.377775 --- ParallelTerminationStrategy: PID 14975 died... 11:39:22.396563 run iperf3-srv_10.42.42.10(pid=14975): Terminated {rc=256} 11:39:22.440826 --- ParallelTerminationStrategy: PID 14976 died... 11:39:22.460117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14976): Terminated: ok {rc=0} 11:39:22.504524 --- ParallelTerminationStrategy: PID 14977 died... 11:39:22.523409 run iperf3-srv_10.42.42.10(pid=14977): Terminated {rc=256} 11:39:22.567694 --- ParallelTerminationStrategy: PID 14978 died... 11:39:22.586464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14978): Terminated: ok {rc=0} 11:39:22.630800 --- ParallelTerminationStrategy: PID 14979 died... 11:39:22.649559 run iperf3-srv_10.42.42.10(pid=14979): Terminated {rc=256} 11:39:22.693835 --- ParallelTerminationStrategy: PID 14980 died... 11:39:22.712638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14980): Terminated: ok {rc=0} 11:39:22.756774 --- ParallelTerminationStrategy: PID 14981 died... 11:39:22.775524 run iperf3-srv_10.42.42.10(pid=14981): Terminated {rc=256} 11:39:22.819648 --- ParallelTerminationStrategy: PID 14984 died... 11:39:22.838529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14984): Terminated: ok {rc=0} 11:39:22.882684 --- ParallelTerminationStrategy: PID 14987 died... 11:39:22.901444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14987): Terminated: ok {rc=0} 11:39:22.945659 --- ParallelTerminationStrategy: PID 14990 died... 11:39:22.964840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14990): Terminated: ok {rc=0} 11:39:23.049081 bus /gobi_4: Setting Powered False 11:39:24.147935 bus /gobi_4: Setting Powered False 11:39:25.265675 bus /gobi_1: Setting Powered False 11:39:26.364635 bus /gobi_1: Setting Powered False 11:39:27.480427 bus /gobi_0: Setting Powered False 11:39:28.579436 bus /gobi_0: Setting Powered False 11:39:29.698325 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo ping.py ---------------------------------------------- 11:39:30.801934 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:30.814143 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:39:30.850751 tst ping.py: using LAC 33687 11:39:31.015230 tst ping.py: using RAC 27 11:39:31.142937 tst ping.py: using CellId 33687 11:39:31.302146 tst ping.py: using BVCI 33688 11:39:31.444834 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:31.459468 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:31.472670 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:31.485695 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:31.498950 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:31.512216 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:31.526210 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:31.539705 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:39:31.664348 tst ping.py:19: start network... 11:39:31.899962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:32.381662 run create_hlr_db(pid=14992): Launched 11:39:32.506884 bus /gobi_6: Setting Powered False 11:39:33.568025 run create_hlr_db(pid=14992): Terminated: ok {rc=0} 11:39:34.017533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14994): Launched 11:39:34.348929 run osmo-hlr_10.42.42.2(pid=14995): Launched 11:39:34.476314 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:35.044314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14997): Launched 11:39:35.374042 run osmo-stp_10.42.42.5(pid=14998): Launched 11:39:35.498761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:36.065616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15000): Launched 11:39:36.191601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:36.471051 run patchelf(pid=15001): Launched 11:39:36.641409 run osmo-stp_10.42.42.5(pid=14998): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14998)] 11:39:36.770894 run osmo-stp_10.42.42.5(pid=14998): stdout: | (launched: 2022-12-13_11:39:35.312564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:36.902039 run osmo-stp_10.42.42.5(pid=14998): stderr: | 20221213113935509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113935509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113935509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113935510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113935510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113935510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113935510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:37.033232 run osmo-stp_10.42.42.5(pid=14998): stdout: | (launched: 2022-12-13_11:39:35.312564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:37.159197 run osmo-stp_10.42.42.5(pid=14998): stderr: | 20221213113935509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113935509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113935509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113935510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113935510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113935510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113935510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:37.307004 run patchelf(pid=15001): Terminating (SIGINT) 11:39:37.476940 run patchelf(pid=15001): Terminated: ok {rc=0} 11:39:37.600221 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14998): Process ended prematurely: osmo-stp_10.42.42.5(pid=14998) [trial-2389↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14998)] [trial-2389↪gprs:sysmo↪ping.py:22] 11:39:37.609898 tst ping.py:22: Test FAILED (6.8 sec) 11:39:37.636926 run osmo-hlr_10.42.42.2(pid=14995): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14995)] 11:39:37.685534 run osmo-hlr_10.42.42.2(pid=14995): stdout: | (launched: 2022-12-13_11:39:34.287594) 11:39:37.735550 run osmo-hlr_10.42.42.2(pid=14995): stderr: | 20221213113934489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113934489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113934489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113934489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113934489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113934489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113934502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113934510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113934511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113934511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:37.786010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14994): Terminating (SIGTERM) 11:39:37.826673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14997): Terminating (SIGTERM) 11:39:37.867299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15000): Terminating (SIGTERM) 11:39:37.908107 --- ParallelTerminationStrategy: PID 14994 died... 11:39:37.927870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14994): Terminated: ok {rc=0} 11:39:37.972765 --- ParallelTerminationStrategy: PID 14997 died... 11:39:37.991724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14997): Terminated: ok {rc=0} 11:39:38.036531 --- ParallelTerminationStrategy: PID 15000 died... 11:39:38.055711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15000): Terminated: ok {rc=0} 11:39:38.140781 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 11:39:39.229226 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:39.241750 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:39:39.279461 tst ping_idle_ping.py: using LAC 33688 11:39:39.413610 tst ping_idle_ping.py: using RAC 28 11:39:39.533548 tst ping_idle_ping.py: using CellId 33688 11:39:39.651191 tst ping_idle_ping.py: using BVCI 33689 11:39:39.763468 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:39.774145 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:39.784670 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:39.795179 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:39.805548 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:39.816323 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:39.827364 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:39:39.838397 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:39:39.962132 tst ping_idle_ping.py:24: start network... 11:39:40.168144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:40.643684 run create_hlr_db(pid=15004): Launched 11:39:40.769253 bus /gobi_6: Setting Powered False 11:39:41.830388 run create_hlr_db(pid=15004): Terminated: ok {rc=0} 11:39:42.257659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15006): Launched 11:39:42.565250 run osmo-hlr_10.42.42.2(pid=15007): Launched 11:39:42.682907 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:43.207869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15009): Launched 11:39:43.515634 run osmo-stp_10.42.42.5(pid=15010): Launched 11:39:43.632884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:44.164039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15012): Launched 11:39:44.282221 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:44.542680 run patchelf(pid=15013): Launched 11:39:44.713098 run osmo-stp_10.42.42.5(pid=15010): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15010)] 11:39:44.842411 run osmo-stp_10.42.42.5(pid=15010): stdout: | (launched: 2022-12-13_11:39:43.457983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:44.972793 run osmo-stp_10.42.42.5(pid=15010): stderr: | 20221213113943631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113943631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113943631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113943632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113943632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113943632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113943632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:45.103595 run osmo-stp_10.42.42.5(pid=15010): stdout: | (launched: 2022-12-13_11:39:43.457983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:45.228815 run osmo-stp_10.42.42.5(pid=15010): stderr: | 20221213113943631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113943631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113943631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113943632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113943632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113943632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113943632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:45.376710 run patchelf(pid=15013): Terminating (SIGINT) 11:39:45.547141 run patchelf(pid=15013): Terminated: ok {rc=0} 11:39:45.670186 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15010): Process ended prematurely: osmo-stp_10.42.42.5(pid=15010) [trial-2389↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15010)] [trial-2389↪gprs:sysmo↪ping_idle_ping.py:27] 11:39:45.679070 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:39:45.705584 run osmo-hlr_10.42.42.2(pid=15007): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15007)] 11:39:45.753493 run osmo-hlr_10.42.42.2(pid=15007): stdout: | (launched: 2022-12-13_11:39:42.507326) 11:39:45.802745 run osmo-hlr_10.42.42.2(pid=15007): stderr: | 20221213113942689 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113942689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113942689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113942689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113942689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113942689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113942739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113942749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113942750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113942750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:45.852274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15006): Terminating (SIGTERM) 11:39:45.892088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15009): Terminating (SIGTERM) 11:39:45.931984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15012): Terminating (SIGTERM) 11:39:45.972309 --- ParallelTerminationStrategy: PID 15006 died... 11:39:45.991578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15006): Terminated: ok {rc=0} 11:39:46.036172 --- ParallelTerminationStrategy: PID 15009 died... 11:39:46.055470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15009): Terminated: ok {rc=0} 11:39:46.100299 --- ParallelTerminationStrategy: PID 15012 died... 11:39:46.119415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15012): Terminated: ok {rc=0} 11:39:46.205860 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 11:39:47.516436 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:39:47.522858 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:39:47.544876 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:39:47.588671 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:39:47.678348 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:39:47.700165 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:39:47.740887 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:39:48.337702 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:39:48.390466 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:48.401547 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:39:48.437747 tst cs_paging_gprs_active.py: using LAC 33689 11:39:48.568789 tst cs_paging_gprs_active.py: using RAC 29 11:39:48.702970 tst cs_paging_gprs_active.py: using CellId 33689 11:39:48.834898 tst cs_paging_gprs_active.py: using BVCI 33690 11:39:48.957241 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:48.968630 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:48.979791 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:48.991035 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:49.002945 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:49.014768 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:49.026840 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:49.038770 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:39:49.050949 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:39:49.172240 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:39:49.289526 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:39:49.499351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:49.814856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15017): Launched 11:39:50.089707 run iperf3-srv_10.42.42.10(pid=15018): Launched 11:39:50.206817 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:39:50.416899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:50.732661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15019): Launched 11:39:51.006019 run iperf3-srv_10.42.42.10(pid=15020): Launched 11:39:51.124911 tst cs_paging_gprs_active.py:38: start network... 11:39:51.334835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:51.818578 run create_hlr_db(pid=15021): Launched 11:39:51.947960 bus /gobi_6: Setting Powered False 11:39:53.010078 run create_hlr_db(pid=15021): Terminated: ok {rc=0} 11:39:53.467187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15023): Launched 11:39:53.803642 run osmo-hlr_10.42.42.2(pid=15024): Launched 11:39:53.933295 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:54.508696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15026): Launched 11:39:54.845392 run osmo-stp_10.42.42.5(pid=15027): Launched 11:39:54.975182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:55.554180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15029): Launched 11:39:55.684799 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:55.969561 run patchelf(pid=15030): Launched 11:39:56.156216 run osmo-stp_10.42.42.5(pid=15027): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15027)] 11:39:56.298060 run osmo-stp_10.42.42.5(pid=15027): stdout: | (launched: 2022-12-13_11:39:54.783252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:56.442048 run osmo-stp_10.42.42.5(pid=15027): stderr: | 20221213113954979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113954979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113954980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113954980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113954980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113954981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113954981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:56.586292 run osmo-stp_10.42.42.5(pid=15027): stdout: | (launched: 2022-12-13_11:39:54.783252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:56.723569 run osmo-stp_10.42.42.5(pid=15027): stderr: | 20221213113954979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213113954979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213113954980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213113954980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213113954980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213113954981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213113954981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:56.886791 run patchelf(pid=15030): Terminating (SIGINT) 11:39:57.074353 run patchelf(pid=15030): Terminated: ok {rc=0} 11:39:57.209377 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15027): Process ended prematurely: osmo-stp_10.42.42.5(pid=15027) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15027)] [trial-2389↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:39:57.219831 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:39:57.248759 run osmo-hlr_10.42.42.2(pid=15024): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15024)] 11:39:57.299663 run osmo-hlr_10.42.42.2(pid=15024): stdout: | (launched: 2022-12-13_11:39:53.741362) 11:39:57.352085 run osmo-hlr_10.42.42.2(pid=15024): stderr: | 20221213113953944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213113953945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213113953945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213113953945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213113953945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213113953945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213113954003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213113954012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213113954012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213113954012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:57.405566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15017): Terminating (SIGTERM) 11:39:57.447614 run iperf3-srv_10.42.42.10(pid=15018): Terminating (SIGTERM) 11:39:57.490079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15019): Terminating (SIGTERM) 11:39:57.532456 run iperf3-srv_10.42.42.10(pid=15020): Terminating (SIGTERM) 11:39:57.575108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15023): Terminating (SIGTERM) 11:39:57.617329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15026): Terminating (SIGTERM) 11:39:57.659836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15029): Terminating (SIGTERM) 11:39:57.702459 --- ParallelTerminationStrategy: PID 15017 died... 11:39:57.722566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15017): Terminated: ok {rc=0} 11:39:57.769338 --- ParallelTerminationStrategy: PID 15018 died... 11:39:57.789164 run iperf3-srv_10.42.42.10(pid=15018): Terminated {rc=256} 11:39:57.835575 --- ParallelTerminationStrategy: PID 15019 died... 11:39:57.855639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15019): Terminated: ok {rc=0} 11:39:57.902286 --- ParallelTerminationStrategy: PID 15020 died... 11:39:57.922064 run iperf3-srv_10.42.42.10(pid=15020): Terminated {rc=256} 11:39:57.968483 --- ParallelTerminationStrategy: PID 15023 died... 11:39:57.988404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15023): Terminated: ok {rc=0} 11:39:58.034841 --- ParallelTerminationStrategy: PID 15026 died... 11:39:58.054713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15026): Terminated: ok {rc=0} 11:39:58.101416 --- ParallelTerminationStrategy: PID 15029 died... 11:39:58.121788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15029): Terminated: ok {rc=0} 11:39:58.209712 bus /gobi_0: Setting Powered False 11:39:59.307572 bus /gobi_0: Setting Powered False 11:40:00.422314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:40:01.572092 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:01.584580 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:40:01.623237 tst iperf3.py: using LAC 33690 11:40:01.774669 tst iperf3.py: using RAC 30 11:40:01.933128 tst iperf3.py: using CellId 33690 11:40:02.080190 tst iperf3.py: using BVCI 33691 11:40:02.198989 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:02.210480 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:02.221901 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:02.233867 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:02.245707 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:02.257147 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:02.268373 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:02.279626 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:02.291058 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:02.411861 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:40:02.621937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:02.935616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15034): Launched 11:40:03.208797 run iperf3-srv_10.42.42.10(pid=15035): Launched 11:40:03.327801 tst iperf3.py:8: start network... 11:40:03.536699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:04.018789 run create_hlr_db(pid=15036): Launched 11:40:04.147548 bus /gobi_6: Setting Powered False 11:40:05.209446 run create_hlr_db(pid=15036): Terminated: ok {rc=0} 11:40:05.666586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15038): Launched 11:40:06.003222 run osmo-hlr_10.42.42.2(pid=15039): Launched 11:40:06.132526 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:06.707596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15041): Launched 11:40:07.041457 run osmo-stp_10.42.42.5(pid=15042): Launched 11:40:07.170114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:07.750452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15044): Launched 11:40:07.878239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:08.161851 run patchelf(pid=15045): Launched 11:40:08.348147 run osmo-stp_10.42.42.5(pid=15042): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15042)] 11:40:08.489368 run osmo-stp_10.42.42.5(pid=15042): stdout: | (launched: 2022-12-13_11:40:06.979276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:08.632203 run osmo-stp_10.42.42.5(pid=15042): stderr: | 20221213114007180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114007180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114007181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114007181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114007181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114007182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114007182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:08.775653 run osmo-stp_10.42.42.5(pid=15042): stdout: | (launched: 2022-12-13_11:40:06.979276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:08.912303 run osmo-stp_10.42.42.5(pid=15042): stderr: | 20221213114007180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114007180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114007181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114007181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114007181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114007182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114007182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:09.074354 run patchelf(pid=15045): Terminating (SIGINT) 11:40:09.260845 run patchelf(pid=15045): Terminated: ok {rc=0} 11:40:09.396117 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15042): Process ended prematurely: osmo-stp_10.42.42.5(pid=15042) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15042)] [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 11:40:09.406492 tst iperf3.py:8: Test FAILED (7.9 sec) 11:40:09.435100 run osmo-hlr_10.42.42.2(pid=15039): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15039)] 11:40:09.486054 run osmo-hlr_10.42.42.2(pid=15039): stdout: | (launched: 2022-12-13_11:40:05.940814) 11:40:09.538536 run osmo-hlr_10.42.42.2(pid=15039): stderr: | 20221213114006142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114006142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114006142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114006143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114006143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114006143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114006155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114006163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114006163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114006163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:09.591708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15034): Terminating (SIGTERM) 11:40:09.634448 run iperf3-srv_10.42.42.10(pid=15035): Terminating (SIGTERM) 11:40:09.677692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15038): Terminating (SIGTERM) 11:40:09.720406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15041): Terminating (SIGTERM) 11:40:09.763280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15044): Terminating (SIGTERM) 11:40:09.806418 --- ParallelTerminationStrategy: PID 15034 died... 11:40:09.827227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15034): Terminated: ok {rc=0} 11:40:09.874544 --- ParallelTerminationStrategy: PID 15035 died... 11:40:09.894675 run iperf3-srv_10.42.42.10(pid=15035): Terminated {rc=256} 11:40:09.941517 --- ParallelTerminationStrategy: PID 15038 died... 11:40:09.961723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15038): Terminated: ok {rc=0} 11:40:10.009342 --- ParallelTerminationStrategy: PID 15041 died... 11:40:10.029625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15041): Terminated: ok {rc=0} 11:40:10.076781 --- ParallelTerminationStrategy: PID 15044 died... 11:40:10.097555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15044): Terminated: ok {rc=0} 11:40:10.186684 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:40:11.339502 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:11.351992 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:40:11.390687 tst iperf3m4.py: using LAC 33691 11:40:11.513782 tst iperf3m4.py: using RAC 31 11:40:11.637375 tst iperf3m4.py: using CellId 33691 11:40:11.759718 tst iperf3m4.py: using BVCI 33692 11:40:11.874658 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:11.885723 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:11.896801 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:11.907578 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:11.918289 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:11.930177 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:11.941730 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:11.952898 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:11.964235 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:12.085969 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:12.207356 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:12.329696 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:12.452418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:40:12.680138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:12.998044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15046): Launched 11:40:13.272827 run iperf3-srv_10.42.42.10(pid=15047): Launched 11:40:13.389946 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:40:13.599985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:13.915002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15048): Launched 11:40:14.189920 run iperf3-srv_10.42.42.10(pid=15049): Launched 11:40:14.306284 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:40:14.515300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:14.830226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15050): Launched 11:40:15.103578 run iperf3-srv_10.42.42.10(pid=15051): Launched 11:40:15.221490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:40:15.431140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:15.745690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15052): Launched 11:40:16.027056 run iperf3-srv_10.42.42.10(pid=15053): Launched 11:40:16.192444 tst iperf3m4.py:8: start network... 11:40:16.410431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:16.903748 run create_hlr_db(pid=15054): Launched 11:40:17.062139 bus /gobi_6: Setting Powered False 11:40:18.123004 run create_hlr_db(pid=15054): Terminated: ok {rc=0} 11:40:18.579624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15056): Launched 11:40:18.915289 run osmo-hlr_10.42.42.2(pid=15057): Launched 11:40:19.043416 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:19.622219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15059): Launched 11:40:19.958745 run osmo-stp_10.42.42.5(pid=15060): Launched 11:40:20.085305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:20.661730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15062): Launched 11:40:20.791450 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:21.076122 run patchelf(pid=15063): Launched 11:40:21.262760 run osmo-stp_10.42.42.5(pid=15060): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15060)] 11:40:21.404370 run osmo-stp_10.42.42.5(pid=15060): stdout: | (launched: 2022-12-13_11:40:19.896138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:21.547370 run osmo-stp_10.42.42.5(pid=15060): stderr: | 20221213114020093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114020093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114020093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114020094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114020094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114020094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114020094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:21.690418 run osmo-stp_10.42.42.5(pid=15060): stdout: | (launched: 2022-12-13_11:40:19.896138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:21.826804 run osmo-stp_10.42.42.5(pid=15060): stderr: | 20221213114020093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114020093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114020093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114020094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114020094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114020094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114020094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:21.988409 run patchelf(pid=15063): Terminating (SIGINT) 11:40:22.174375 run patchelf(pid=15063): Terminated: ok {rc=0} 11:40:22.309122 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15060): Process ended prematurely: osmo-stp_10.42.42.5(pid=15060) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15060)] [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 11:40:22.319607 tst iperf3m4.py:8: Test FAILED (11.0 sec) 11:40:22.348703 run osmo-hlr_10.42.42.2(pid=15057): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15057)] 11:40:22.400238 run osmo-hlr_10.42.42.2(pid=15057): stdout: | (launched: 2022-12-13_11:40:18.853003) 11:40:22.453246 run osmo-hlr_10.42.42.2(pid=15057): stderr: | 20221213114019053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114019053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114019053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114019053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114019053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114019053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114019065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114019075 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114019075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114019075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:22.506973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15046): Terminating (SIGTERM) 11:40:22.549311 run iperf3-srv_10.42.42.10(pid=15047): Terminating (SIGTERM) 11:40:22.592078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15048): Terminating (SIGTERM) 11:40:22.634887 run iperf3-srv_10.42.42.10(pid=15049): Terminating (SIGTERM) 11:40:22.678047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15050): Terminating (SIGTERM) 11:40:22.720827 run iperf3-srv_10.42.42.10(pid=15051): Terminating (SIGTERM) 11:40:22.763786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15052): Terminating (SIGTERM) 11:40:22.806637 run iperf3-srv_10.42.42.10(pid=15053): Terminating (SIGTERM) 11:40:22.849621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15056): Terminating (SIGTERM) 11:40:22.892440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15059): Terminating (SIGTERM) 11:40:22.935088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15062): Terminating (SIGTERM) 11:40:22.978542 --- ParallelTerminationStrategy: PID 15046 died... 11:40:22.999331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15046): Terminated: ok {rc=0} 11:40:23.046779 --- ParallelTerminationStrategy: PID 15047 died... 11:40:23.067234 run iperf3-srv_10.42.42.10(pid=15047): Terminated {rc=256} 11:40:23.114904 --- ParallelTerminationStrategy: PID 15048 died... 11:40:23.135406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15048): Terminated: ok {rc=0} 11:40:23.182455 --- ParallelTerminationStrategy: PID 15049 died... 11:40:23.202801 run iperf3-srv_10.42.42.10(pid=15049): Terminated {rc=256} 11:40:23.249821 --- ParallelTerminationStrategy: PID 15050 died... 11:40:23.270204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15050): Terminated: ok {rc=0} 11:40:23.317815 --- ParallelTerminationStrategy: PID 15051 died... 11:40:23.338164 run iperf3-srv_10.42.42.10(pid=15051): Terminated {rc=256} 11:40:23.385143 --- ParallelTerminationStrategy: PID 15052 died... 11:40:23.405576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15052): Terminated: ok {rc=0} 11:40:23.452788 --- ParallelTerminationStrategy: PID 15053 died... 11:40:23.473468 run iperf3-srv_10.42.42.10(pid=15053): Terminated {rc=256} 11:40:23.520135 --- ParallelTerminationStrategy: PID 15056 died... 11:40:23.540296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15056): Terminated: ok {rc=0} 11:40:23.587152 --- ParallelTerminationStrategy: PID 15059 died... 11:40:23.607367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15059): Terminated: ok {rc=0} 11:40:23.654269 --- ParallelTerminationStrategy: PID 15062 died... 11:40:23.674547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15062): Terminated: ok {rc=0} 11:40:23.764407 bus /gobi_4: Setting Powered False 11:40:24.864081 bus /gobi_4: Setting Powered False 11:40:25.981987 bus /gobi_1: Setting Powered False 11:40:27.081399 bus /gobi_1: Setting Powered False 11:40:28.198258 bus /gobi_0: Setting Powered False 11:40:29.296475 bus /gobi_0: Setting Powered False 11:40:30.414239 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 11:40:31.523001 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:31.538017 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:40:31.582964 tst ping.py: using LAC 33692 11:40:31.739506 tst ping.py: using RAC 32 11:40:31.887828 tst ping.py: using CellId 33692 11:40:32.067690 tst ping.py: using BVCI 33693 11:40:32.222317 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:32.237338 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:32.252929 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:32.268008 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:32.281045 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:32.294060 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:32.306094 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:32.318103 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:32.443846 tst ping.py:19: start network... 11:40:32.667082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:33.177724 run create_hlr_db(pid=15064): Launched 11:40:33.312091 bus /gobi_6: Setting Powered False 11:40:34.376584 run create_hlr_db(pid=15064): Terminated: ok {rc=0} 11:40:34.817966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15066): Launched 11:40:35.127701 run osmo-hlr_10.42.42.2(pid=15067): Launched 11:40:35.245642 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:35.812154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15069): Launched 11:40:36.142687 run osmo-stp_10.42.42.5(pid=15070): Launched 11:40:36.269413 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:36.838955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15072): Launched 11:40:36.964126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:37.242993 run patchelf(pid=15073): Launched 11:40:37.427141 run osmo-stp_10.42.42.5(pid=15070): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15070)] 11:40:37.566663 run osmo-stp_10.42.42.5(pid=15070): stdout: | (launched: 2022-12-13_11:40:36.081569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:37.707772 run osmo-stp_10.42.42.5(pid=15070): stderr: | 20221213114036277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114036277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114036277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114036278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114036278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114036278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114036278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:37.848700 run osmo-stp_10.42.42.5(pid=15070): stdout: | (launched: 2022-12-13_11:40:36.081569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:37.983160 run osmo-stp_10.42.42.5(pid=15070): stderr: | 20221213114036277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114036277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114036277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114036278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114036278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114036278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114036278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:38.142329 run patchelf(pid=15073): Terminating (SIGINT) 11:40:38.325385 run patchelf(pid=15073): Terminated: ok {rc=0} 11:40:38.457130 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15070): Process ended prematurely: osmo-stp_10.42.42.5(pid=15070) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15070)] [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 11:40:38.466918 tst ping.py:22: Test FAILED (6.9 sec) 11:40:38.495451 run osmo-hlr_10.42.42.2(pid=15067): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15067)] 11:40:38.547111 run osmo-hlr_10.42.42.2(pid=15067): stdout: | (launched: 2022-12-13_11:40:35.069962) 11:40:38.600571 run osmo-hlr_10.42.42.2(pid=15067): stderr: | 20221213114035247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114035247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114035247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114035247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114035247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114035247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114035261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114035270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114035270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114035270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:38.654212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15066): Terminating (SIGTERM) 11:40:38.697663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15069): Terminating (SIGTERM) 11:40:38.740916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15072): Terminating (SIGTERM) 11:40:38.784041 --- ParallelTerminationStrategy: PID 15066 died... 11:40:38.804936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15066): Terminated: ok {rc=0} 11:40:38.852718 --- ParallelTerminationStrategy: PID 15069 died... 11:40:38.873167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15069): Terminated: ok {rc=0} 11:40:38.920466 --- ParallelTerminationStrategy: PID 15072 died... 11:40:38.940738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15072): Terminated: ok {rc=0} 11:40:39.031013 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:40:40.119137 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:40.131470 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:40:40.171551 tst ping_idle_ping.py: using LAC 33693 11:40:40.293597 tst ping_idle_ping.py: using RAC 33 11:40:40.414510 tst ping_idle_ping.py: using CellId 33693 11:40:40.534860 tst ping_idle_ping.py: using BVCI 33694 11:40:40.647093 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:40.658172 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:40.669178 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:40.680038 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:40.690887 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:40.701784 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:40.713073 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:40.723851 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:40.847704 tst ping_idle_ping.py:24: start network... 11:40:41.052702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:41.525640 run create_hlr_db(pid=15074): Launched 11:40:41.644413 bus /gobi_6: Setting Powered False 11:40:42.706588 run create_hlr_db(pid=15074): Terminated: ok {rc=0} 11:40:43.134931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15076): Launched 11:40:43.443981 run osmo-hlr_10.42.42.2(pid=15077): Launched 11:40:43.562805 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:44.112830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15079): Launched 11:40:44.419925 run osmo-stp_10.42.42.5(pid=15080): Launched 11:40:44.538522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:45.068648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15082): Launched 11:40:45.187200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:45.446667 run patchelf(pid=15083): Launched 11:40:45.618633 run osmo-stp_10.42.42.5(pid=15080): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15080)] 11:40:45.748173 run osmo-stp_10.42.42.5(pid=15080): stdout: | (launched: 2022-12-13_11:40:44.362170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:45.881844 run osmo-stp_10.42.42.5(pid=15080): stderr: | 20221213114044536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114044536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114044536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114044537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114044539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114044539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114044539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:46.046051 run osmo-stp_10.42.42.5(pid=15080): stdout: | (launched: 2022-12-13_11:40:44.362170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:46.186471 run osmo-stp_10.42.42.5(pid=15080): stderr: | 20221213114044536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114044536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114044536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114044537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114044539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114044539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114044539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:46.351285 run patchelf(pid=15083): Terminating (SIGINT) 11:40:46.540055 run patchelf(pid=15083): Terminated: ok {rc=0} 11:40:46.679778 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15080): Process ended prematurely: osmo-stp_10.42.42.5(pid=15080) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15080)] [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 11:40:46.690923 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 11:40:46.720418 run osmo-hlr_10.42.42.2(pid=15077): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15077)] 11:40:46.775682 run osmo-hlr_10.42.42.2(pid=15077): stdout: | (launched: 2022-12-13_11:40:43.386048) 11:40:46.830582 run osmo-hlr_10.42.42.2(pid=15077): stderr: | 20221213114043566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114043566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114043566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114043566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114043566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114043566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114043579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114043590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114043590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114043590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:46.887746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15076): Terminating (SIGTERM) 11:40:46.931691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15079): Terminating (SIGTERM) 11:40:46.979044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15082): Terminating (SIGTERM) 11:40:47.026176 --- ParallelTerminationStrategy: PID 15076 died... 11:40:47.048706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15076): Terminated: ok {rc=0} 11:40:47.099882 --- ParallelTerminationStrategy: PID 15079 died... 11:40:47.121385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15079): Terminated: ok {rc=0} 11:40:47.171228 --- ParallelTerminationStrategy: PID 15082 died... 11:40:47.192189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15082): Terminated: ok {rc=0} 11:40:47.281691 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:40:48.572709 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:40:48.579041 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:40:48.600427 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:40:48.639660 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:40:48.727595 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:40:48.748585 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:40:48.787113 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:40:49.381660 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:40:49.431499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:49.442534 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:40:49.499366 tst cs_paging_gprs_active.py: using LAC 33694 11:40:49.624032 tst cs_paging_gprs_active.py: using RAC 34 11:40:49.748349 tst cs_paging_gprs_active.py: using CellId 33694 11:40:49.871558 tst cs_paging_gprs_active.py: using BVCI 33695 11:40:49.995749 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:50.007539 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:50.019046 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:50.030528 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:50.042391 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:50.054280 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:50.066436 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:50.078319 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:40:50.090311 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:40:50.208717 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:40:50.331527 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:40:50.558242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:50.895309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15089): Launched 11:40:51.187304 run iperf3-srv_10.42.42.10(pid=15090): Launched 11:40:51.312910 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:40:51.538785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:51.878598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15092): Launched 11:40:52.174884 run iperf3-srv_10.42.42.10(pid=15093): Launched 11:40:52.299482 tst cs_paging_gprs_active.py:38: start network... 11:40:52.524905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:53.043630 run create_hlr_db(pid=15094): Launched 11:40:53.170644 bus /gobi_6: Setting Powered False 11:40:54.236363 run create_hlr_db(pid=15094): Terminated: ok {rc=0} 11:40:54.683477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15096): Launched 11:40:54.996861 run osmo-hlr_10.42.42.2(pid=15097): Launched 11:40:55.116139 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:55.670491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15099): Launched 11:40:55.984125 run osmo-stp_10.42.42.5(pid=15100): Launched 11:40:56.103997 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:56.644247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15102): Launched 11:40:56.764456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:57.029238 run patchelf(pid=15103): Launched 11:40:57.202135 run osmo-stp_10.42.42.5(pid=15100): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15100)] 11:40:57.333409 run osmo-stp_10.42.42.5(pid=15100): stdout: | (launched: 2022-12-13_11:40:55.925428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:57.467133 run osmo-stp_10.42.42.5(pid=15100): stderr: | 20221213114056100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114056100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114056100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114056101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114056103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114056103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114056103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:57.600752 run osmo-stp_10.42.42.5(pid=15100): stdout: | (launched: 2022-12-13_11:40:55.925428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:57.728361 run osmo-stp_10.42.42.5(pid=15100): stderr: | 20221213114056100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114056100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114056100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114056101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114056103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114056103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114056103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:57.878817 run patchelf(pid=15103): Terminating (SIGINT) 11:40:58.053863 run patchelf(pid=15103): Terminated: ok {rc=0} 11:40:58.179143 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15100): Process ended prematurely: osmo-stp_10.42.42.5(pid=15100) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15100)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:40:58.188744 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:40:58.216019 run osmo-hlr_10.42.42.2(pid=15097): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15097)] 11:40:58.263501 run osmo-hlr_10.42.42.2(pid=15097): stdout: | (launched: 2022-12-13_11:40:54.938165) 11:40:58.313076 run osmo-hlr_10.42.42.2(pid=15097): stderr: | 20221213114055120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114055120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114055120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114055120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114055120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114055120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114055133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114055142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114055142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114055142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:58.362677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15089): Terminating (SIGTERM) 11:40:58.402327 run iperf3-srv_10.42.42.10(pid=15090): Terminating (SIGTERM) 11:40:58.441733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15092): Terminating (SIGTERM) 11:40:58.481305 run iperf3-srv_10.42.42.10(pid=15093): Terminating (SIGTERM) 11:40:58.520818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15096): Terminating (SIGTERM) 11:40:58.560546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15099): Terminating (SIGTERM) 11:40:58.600075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15102): Terminating (SIGTERM) 11:40:58.639732 --- ParallelTerminationStrategy: PID 15089 died... 11:40:58.658844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15089): Terminated: ok {rc=0} 11:40:58.702844 --- ParallelTerminationStrategy: PID 15090 died... 11:40:58.721428 run iperf3-srv_10.42.42.10(pid=15090): Terminated {rc=256} 11:40:58.765164 --- ParallelTerminationStrategy: PID 15092 died... 11:40:58.783592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15092): Terminated: ok {rc=0} 11:40:58.827320 --- ParallelTerminationStrategy: PID 15093 died... 11:40:58.845726 run iperf3-srv_10.42.42.10(pid=15093): Terminated {rc=256} 11:40:58.889500 --- ParallelTerminationStrategy: PID 15096 died... 11:40:58.908176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15096): Terminated: ok {rc=0} 11:40:58.952006 --- ParallelTerminationStrategy: PID 15099 died... 11:40:58.970731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15099): Terminated: ok {rc=0} 11:40:59.014383 --- ParallelTerminationStrategy: PID 15102 died... 11:40:59.033045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15102): Terminated: ok {rc=0} 11:40:59.118967 bus /gobi_0: Setting Powered False 11:41:00.218191 bus /gobi_0: Setting Powered False 11:41:01.343188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:41:02.511389 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:02.523603 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:41:02.589259 tst iperf3.py: using LAC 33695 11:41:02.720326 tst iperf3.py: using RAC 35 11:41:02.849266 tst iperf3.py: using CellId 33695 11:41:02.981321 tst iperf3.py: using BVCI 33696 11:41:03.103826 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:03.115493 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:03.126833 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:03.138286 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:03.149917 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:03.161642 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:03.173461 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:03.184823 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:03.196724 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:03.315247 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:41:03.528132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:03.844924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15104): Launched 11:41:04.120488 run iperf3-srv_10.42.42.10(pid=15105): Launched 11:41:04.239048 tst iperf3.py:8: start network... 11:41:04.449142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:04.932492 run create_hlr_db(pid=15106): Launched 11:41:05.061237 bus /gobi_6: Setting Powered False 11:41:06.123264 run create_hlr_db(pid=15106): Terminated: ok {rc=0} 11:41:06.579729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15108): Launched 11:41:06.915436 run osmo-hlr_10.42.42.2(pid=15109): Launched 11:41:07.044546 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:07.624083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15111): Launched 11:41:07.960732 run osmo-stp_10.42.42.5(pid=15112): Launched 11:41:08.089088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:08.665060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15114): Launched 11:41:08.795084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:09.078700 run patchelf(pid=15115): Launched 11:41:09.265393 run osmo-stp_10.42.42.5(pid=15112): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15112)] 11:41:09.407148 run osmo-stp_10.42.42.5(pid=15112): stdout: | (launched: 2022-12-13_11:41:07.898492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:09.550014 run osmo-stp_10.42.42.5(pid=15112): stderr: | 20221213114108092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114108093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114108093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114108093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114108096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114108096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114108096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:09.693497 run osmo-stp_10.42.42.5(pid=15112): stdout: | (launched: 2022-12-13_11:41:07.898492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:09.830581 run osmo-stp_10.42.42.5(pid=15112): stderr: | 20221213114108092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114108093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114108093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114108093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114108096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114108096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114108096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:09.992204 run patchelf(pid=15115): Terminating (SIGINT) 11:41:10.178404 run patchelf(pid=15115): Terminated: ok {rc=0} 11:41:10.313298 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15112): Process ended prematurely: osmo-stp_10.42.42.5(pid=15112) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15112)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 11:41:10.323595 tst iperf3.py:8: Test FAILED (7.9 sec) 11:41:10.352416 run osmo-hlr_10.42.42.2(pid=15109): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15109)] 11:41:10.403324 run osmo-hlr_10.42.42.2(pid=15109): stdout: | (launched: 2022-12-13_11:41:06.853391) 11:41:10.455697 run osmo-hlr_10.42.42.2(pid=15109): stderr: | 20221213114107056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114107056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114107056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114107056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114107056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114107056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114107069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114107078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114107079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114107079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:10.508506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15104): Terminating (SIGTERM) 11:41:10.550832 run iperf3-srv_10.42.42.10(pid=15105): Terminating (SIGTERM) 11:41:10.592866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15108): Terminating (SIGTERM) 11:41:10.635236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15111): Terminating (SIGTERM) 11:41:10.677748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15114): Terminating (SIGTERM) 11:41:10.721517 --- ParallelTerminationStrategy: PID 15104 died... 11:41:10.742356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15104): Terminated: ok {rc=0} 11:41:10.789593 --- ParallelTerminationStrategy: PID 15105 died... 11:41:10.809541 run iperf3-srv_10.42.42.10(pid=15105): Terminated {rc=256} 11:41:10.856505 --- ParallelTerminationStrategy: PID 15108 died... 11:41:10.876630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15108): Terminated: ok {rc=0} 11:41:10.923022 --- ParallelTerminationStrategy: PID 15111 died... 11:41:10.942938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15111): Terminated: ok {rc=0} 11:41:10.989580 --- ParallelTerminationStrategy: PID 15114 died... 11:41:11.009797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15114): Terminated: ok {rc=0} 11:41:11.098175 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:41:12.247269 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:12.258948 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:41:12.320049 tst iperf3m4.py: using LAC 33696 11:41:12.442744 tst iperf3m4.py: using RAC 36 11:41:12.565251 tst iperf3m4.py: using CellId 33696 11:41:12.686050 tst iperf3m4.py: using BVCI 33697 11:41:12.811133 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:12.822957 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:12.834614 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:12.846288 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:12.858560 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:12.870968 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:12.885302 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:12.897836 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:12.909416 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:13.032814 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:13.152243 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:13.274887 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:13.394459 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:41:13.622534 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:13.961294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15116): Launched 11:41:14.255799 run iperf3-srv_10.42.42.10(pid=15117): Launched 11:41:14.389773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:41:14.616441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:14.954326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15118): Launched 11:41:15.248024 run iperf3-srv_10.42.42.10(pid=15119): Launched 11:41:15.374850 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:41:15.601813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:15.946010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15120): Launched 11:41:16.248500 run iperf3-srv_10.42.42.10(pid=15121): Launched 11:41:16.383123 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:41:16.601591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:16.933688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15122): Launched 11:41:17.233851 run iperf3-srv_10.42.42.10(pid=15123): Launched 11:41:17.368275 tst iperf3m4.py:8: start network... 11:41:17.595207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:18.114874 run create_hlr_db(pid=15124): Launched 11:41:18.243708 bus /gobi_6: Setting Powered False 11:41:19.309263 run create_hlr_db(pid=15124): Terminated: ok {rc=0} 11:41:19.774900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15126): Launched 11:41:20.109824 run osmo-hlr_10.42.42.2(pid=15127): Launched 11:41:20.239345 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:20.816616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15129): Launched 11:41:21.151277 run osmo-stp_10.42.42.5(pid=15130): Launched 11:41:21.279887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:21.856414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15132): Launched 11:41:21.984429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:22.267256 run patchelf(pid=15133): Launched 11:41:22.452560 run osmo-stp_10.42.42.5(pid=15130): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15130)] 11:41:22.593922 run osmo-stp_10.42.42.5(pid=15130): stdout: | (launched: 2022-12-13_11:41:21.088624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:22.737217 run osmo-stp_10.42.42.5(pid=15130): stderr: | 20221213114121283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114121283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114121283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114121284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114121284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114121284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114121284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:22.880058 run osmo-stp_10.42.42.5(pid=15130): stdout: | (launched: 2022-12-13_11:41:21.088624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:23.016230 run osmo-stp_10.42.42.5(pid=15130): stderr: | 20221213114121283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114121283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114121283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114121284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114121284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114121284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114121284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:23.178620 run patchelf(pid=15133): Terminating (SIGINT) 11:41:23.365092 run patchelf(pid=15133): Terminated: ok {rc=0} 11:41:23.499795 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15130): Process ended prematurely: osmo-stp_10.42.42.5(pid=15130) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15130)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:41:23.510234 tst iperf3m4.py:8: Test FAILED (11.3 sec) 11:41:23.539189 run osmo-hlr_10.42.42.2(pid=15127): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15127)] 11:41:23.590182 run osmo-hlr_10.42.42.2(pid=15127): stdout: | (launched: 2022-12-13_11:41:20.047253) 11:41:23.642162 run osmo-hlr_10.42.42.2(pid=15127): stderr: | 20221213114120247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114120247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114120247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114120247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114120247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114120247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114120261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114120271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114120271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114120271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:23.694830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15116): Terminating (SIGTERM) 11:41:23.737292 run iperf3-srv_10.42.42.10(pid=15117): Terminating (SIGTERM) 11:41:23.779626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15118): Terminating (SIGTERM) 11:41:23.822564 run iperf3-srv_10.42.42.10(pid=15119): Terminating (SIGTERM) 11:41:23.864901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15120): Terminating (SIGTERM) 11:41:23.907690 run iperf3-srv_10.42.42.10(pid=15121): Terminating (SIGTERM) 11:41:23.950058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15122): Terminating (SIGTERM) 11:41:23.992833 run iperf3-srv_10.42.42.10(pid=15123): Terminating (SIGTERM) 11:41:24.035501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15126): Terminating (SIGTERM) 11:41:24.078532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15129): Terminating (SIGTERM) 11:41:24.121310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15132): Terminating (SIGTERM) 11:41:24.164435 --- ParallelTerminationStrategy: PID 15116 died... 11:41:24.185231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15116): Terminated: ok {rc=0} 11:41:24.232156 --- ParallelTerminationStrategy: PID 15117 died... 11:41:24.252120 run iperf3-srv_10.42.42.10(pid=15117): Terminated {rc=256} 11:41:24.298637 --- ParallelTerminationStrategy: PID 15118 died... 11:41:24.318865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15118): Terminated: ok {rc=0} 11:41:24.365596 --- ParallelTerminationStrategy: PID 15119 died... 11:41:24.385515 run iperf3-srv_10.42.42.10(pid=15119): Terminated {rc=256} 11:41:24.432030 --- ParallelTerminationStrategy: PID 15120 died... 11:41:24.452056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15120): Terminated: ok {rc=0} 11:41:24.498775 --- ParallelTerminationStrategy: PID 15121 died... 11:41:24.518797 run iperf3-srv_10.42.42.10(pid=15121): Terminated {rc=256} 11:41:24.565456 --- ParallelTerminationStrategy: PID 15122 died... 11:41:24.585447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15122): Terminated: ok {rc=0} 11:41:24.632325 --- ParallelTerminationStrategy: PID 15123 died... 11:41:24.652449 run iperf3-srv_10.42.42.10(pid=15123): Terminated {rc=256} 11:41:24.699375 --- ParallelTerminationStrategy: PID 15126 died... 11:41:24.719515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15126): Terminated: ok {rc=0} 11:41:24.766304 --- ParallelTerminationStrategy: PID 15129 died... 11:41:24.786405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15129): Terminated: ok {rc=0} 11:41:24.833208 --- ParallelTerminationStrategy: PID 15132 died... 11:41:24.853338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15132): Terminated: ok {rc=0} 11:41:24.942698 bus /gobi_4: Setting Powered False 11:41:26.039575 bus /gobi_4: Setting Powered False 11:41:27.153395 bus /gobi_1: Setting Powered False 11:41:28.252804 bus /gobi_1: Setting Powered False 11:41:29.371631 bus /gobi_0: Setting Powered False 11:41:30.471680 bus /gobi_0: Setting Powered False 11:41:31.597227 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:41:32.714289 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:32.726521 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:41:32.785740 tst ping.py: using LAC 33697 11:41:32.916262 tst ping.py: using RAC 37 11:41:33.045125 tst ping.py: using CellId 33697 11:41:33.172460 tst ping.py: using BVCI 33698 11:41:33.299810 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:33.311621 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:33.323216 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:33.334808 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:33.346683 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:33.358519 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:33.370587 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:33.382428 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:33.503611 tst ping.py:19: start network... 11:41:33.726881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:34.236634 run create_hlr_db(pid=15135): Launched 11:41:34.363031 bus /gobi_6: Setting Powered False 11:41:35.428150 run create_hlr_db(pid=15135): Terminated: ok {rc=0} 11:41:35.888402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15137): Launched 11:41:36.219044 run osmo-hlr_10.42.42.2(pid=15138): Launched 11:41:36.346315 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:36.924370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15140): Launched 11:41:37.254427 run osmo-stp_10.42.42.5(pid=15141): Launched 11:41:37.380726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:37.947034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15143): Launched 11:41:38.073113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:38.350910 run patchelf(pid=15144): Launched 11:41:38.532002 run osmo-stp_10.42.42.5(pid=15141): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15141)] 11:41:38.670487 run osmo-stp_10.42.42.5(pid=15141): stdout: | (launched: 2022-12-13_11:41:37.193251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:38.811354 run osmo-stp_10.42.42.5(pid=15141): stderr: | 20221213114137388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114137388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114137388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114137389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114137389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114137389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114137389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:38.952135 run osmo-stp_10.42.42.5(pid=15141): stdout: | (launched: 2022-12-13_11:41:37.193251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:39.086116 run osmo-stp_10.42.42.5(pid=15141): stderr: | 20221213114137388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114137388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114137388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114137389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114137389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114137389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114137389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:39.244842 run patchelf(pid=15144): Terminating (SIGINT) 11:41:39.427168 run patchelf(pid=15144): Terminated: ok {rc=0} 11:41:39.558630 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15141): Process ended prematurely: osmo-stp_10.42.42.5(pid=15141) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15141)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 11:41:39.568190 tst ping.py:22: Test FAILED (6.8 sec) 11:41:39.596325 run osmo-hlr_10.42.42.2(pid=15138): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15138)] 11:41:39.647230 run osmo-hlr_10.42.42.2(pid=15138): stdout: | (launched: 2022-12-13_11:41:36.157624) 11:41:39.699570 run osmo-hlr_10.42.42.2(pid=15138): stderr: | 20221213114136360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114136360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114136360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114136360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114136360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114136360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114136373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114136381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114136381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114136381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:39.751992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15137): Terminating (SIGTERM) 11:41:39.794232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15140): Terminating (SIGTERM) 11:41:39.836218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15143): Terminating (SIGTERM) 11:41:39.878541 --- ParallelTerminationStrategy: PID 15137 died... 11:41:39.899110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15137): Terminated: ok {rc=0} 11:41:39.946164 --- ParallelTerminationStrategy: PID 15140 died... 11:41:39.966808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15140): Terminated: ok {rc=0} 11:41:40.013317 --- ParallelTerminationStrategy: PID 15143 died... 11:41:40.033419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15143): Terminated: ok {rc=0} 11:41:40.122652 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:41:41.210278 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:41.222630 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:41:41.285944 tst ping_idle_ping.py: using LAC 33698 11:41:41.413991 tst ping_idle_ping.py: using RAC 38 11:41:41.541967 tst ping_idle_ping.py: using CellId 33698 11:41:41.673132 tst ping_idle_ping.py: using BVCI 33699 11:41:41.786420 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:41.797680 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:41.808609 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:41.819525 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:41.831035 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:41.842271 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:41.853729 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:41.864932 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:41.985119 tst ping_idle_ping.py:24: start network... 11:41:42.208587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:42.721620 run create_hlr_db(pid=15145): Launched 11:41:42.849900 bus /gobi_6: Setting Powered False 11:41:43.915208 run create_hlr_db(pid=15145): Terminated: ok {rc=0} 11:41:44.356803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15147): Launched 11:41:44.669401 run osmo-hlr_10.42.42.2(pid=15148): Launched 11:41:44.787968 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:45.326393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15150): Launched 11:41:45.636828 run osmo-stp_10.42.42.5(pid=15151): Launched 11:41:45.756637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:46.339448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15153): Launched 11:41:46.469747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:46.737161 run patchelf(pid=15154): Launched 11:41:46.934883 run osmo-stp_10.42.42.5(pid=15151): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15151)] 11:41:47.078767 run osmo-stp_10.42.42.5(pid=15151): stdout: | (launched: 2022-12-13_11:41:45.578633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:47.224218 run osmo-stp_10.42.42.5(pid=15151): stderr: | 20221213114145752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114145753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114145753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114145753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114145755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114145756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114145756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:47.365586 run osmo-stp_10.42.42.5(pid=15151): stdout: | (launched: 2022-12-13_11:41:45.578633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:47.500364 run osmo-stp_10.42.42.5(pid=15151): stderr: | 20221213114145752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114145753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114145753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114145753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114145755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114145756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114145756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:47.660011 run patchelf(pid=15154): Terminating (SIGINT) 11:41:47.844292 run patchelf(pid=15154): Terminated: ok {rc=0} 11:41:47.977028 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15151): Process ended prematurely: osmo-stp_10.42.42.5(pid=15151) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15151)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:41:47.987141 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:41:48.015765 run osmo-hlr_10.42.42.2(pid=15148): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15148)] 11:41:48.066964 run osmo-hlr_10.42.42.2(pid=15148): stdout: | (launched: 2022-12-13_11:41:44.611325) 11:41:48.119881 run osmo-hlr_10.42.42.2(pid=15148): stderr: | 20221213114144790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114144790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114144790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114144790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114144790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114144790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114144801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114144809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114144809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114144809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:48.173365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15147): Terminating (SIGTERM) 11:41:48.215719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15150): Terminating (SIGTERM) 11:41:48.258617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15153): Terminating (SIGTERM) 11:41:48.302079 --- ParallelTerminationStrategy: PID 15147 died... 11:41:48.323302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15147): Terminated: ok {rc=0} 11:41:48.370692 --- ParallelTerminationStrategy: PID 15150 died... 11:41:48.390928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15150): Terminated: ok {rc=0} 11:41:48.438016 --- ParallelTerminationStrategy: PID 15153 died... 11:41:48.458299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15153): Terminated: ok {rc=0} 11:41:48.547392 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:41:49.834956 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:41:49.840870 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:41:49.861868 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:41:49.901073 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:41:49.988391 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:41:50.009268 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:41:50.047702 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:41:50.642830 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:41:50.692745 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:50.703780 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:41:50.761149 tst cs_paging_gprs_active.py: using LAC 33699 11:41:50.885094 tst cs_paging_gprs_active.py: using RAC 39 11:41:51.007635 tst cs_paging_gprs_active.py: using CellId 33699 11:41:51.131924 tst cs_paging_gprs_active.py: using BVCI 33700 11:41:51.247315 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:51.258271 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:51.269006 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:51.279733 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:51.290385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:51.301678 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:51.312364 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:51.323553 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:41:51.334385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:41:51.452495 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:41:51.574798 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:41:51.802832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:52.141217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15158): Launched 11:41:52.435098 run iperf3-srv_10.42.42.10(pid=15159): Launched 11:41:52.559951 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:41:52.786996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:53.123825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15160): Launched 11:41:53.415067 run iperf3-srv_10.42.42.10(pid=15161): Launched 11:41:53.539999 tst cs_paging_gprs_active.py:38: start network... 11:41:53.765795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:54.283937 run create_hlr_db(pid=15162): Launched 11:41:54.413790 bus /gobi_6: Setting Powered False 11:41:55.479233 run create_hlr_db(pid=15162): Terminated: ok {rc=0} 11:41:55.943820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15164): Launched 11:41:56.279287 run osmo-hlr_10.42.42.2(pid=15165): Launched 11:41:56.408794 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:56.986830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15167): Launched 11:41:57.323257 run osmo-stp_10.42.42.5(pid=15168): Launched 11:41:57.452541 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:58.029975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15170): Launched 11:41:58.157973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:58.442225 run patchelf(pid=15171): Launched 11:41:58.628784 run osmo-stp_10.42.42.5(pid=15168): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15168)] 11:41:58.770473 run osmo-stp_10.42.42.5(pid=15168): stdout: | (launched: 2022-12-13_11:41:57.260941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:58.913711 run osmo-stp_10.42.42.5(pid=15168): stderr: | 20221213114157456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114157457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114157457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114157457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114157458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114157458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114157458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:59.057078 run osmo-stp_10.42.42.5(pid=15168): stdout: | (launched: 2022-12-13_11:41:57.260941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:59.193428 run osmo-stp_10.42.42.5(pid=15168): stderr: | 20221213114157456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114157457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114157457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114157457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114157458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114157458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114157458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:59.355566 run patchelf(pid=15171): Terminating (SIGINT) 11:41:59.542645 run patchelf(pid=15171): Terminated: ok {rc=0} 11:41:59.676893 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15168): Process ended prematurely: osmo-stp_10.42.42.5(pid=15168) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15168)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:41:59.687298 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 11:41:59.716183 run osmo-hlr_10.42.42.2(pid=15165): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15165)] 11:41:59.767274 run osmo-hlr_10.42.42.2(pid=15165): stdout: | (launched: 2022-12-13_11:41:56.216863) 11:41:59.819592 run osmo-hlr_10.42.42.2(pid=15165): stderr: | 20221213114156417 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114156417 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114156417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114156417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114156417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114156417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114156430 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114156441 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114156441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114156441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:59.872180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15158): Terminating (SIGTERM) 11:41:59.914694 run iperf3-srv_10.42.42.10(pid=15159): Terminating (SIGTERM) 11:41:59.956921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15160): Terminating (SIGTERM) 11:41:59.999968 run iperf3-srv_10.42.42.10(pid=15161): Terminating (SIGTERM) 11:42:00.042133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15164): Terminating (SIGTERM) 11:42:00.084407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15167): Terminating (SIGTERM) 11:42:00.127073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15170): Terminating (SIGTERM) 11:42:00.169494 --- ParallelTerminationStrategy: PID 15158 died... 11:42:00.190033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15158): Terminated: ok {rc=0} 11:42:00.237090 --- ParallelTerminationStrategy: PID 15159 died... 11:42:00.257077 run iperf3-srv_10.42.42.10(pid=15159): Terminated {rc=256} 11:42:00.303618 --- ParallelTerminationStrategy: PID 15160 died... 11:42:00.323512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15160): Terminated: ok {rc=0} 11:42:00.370234 --- ParallelTerminationStrategy: PID 15161 died... 11:42:00.390271 run iperf3-srv_10.42.42.10(pid=15161): Terminated {rc=256} 11:42:00.436728 --- ParallelTerminationStrategy: PID 15164 died... 11:42:00.457002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15164): Terminated: ok {rc=0} 11:42:00.503479 --- ParallelTerminationStrategy: PID 15167 died... 11:42:00.523444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15167): Terminated: ok {rc=0} 11:42:00.570069 --- ParallelTerminationStrategy: PID 15170 died... 11:42:00.590003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15170): Terminated: ok {rc=0} 11:42:00.679098 bus /gobi_0: Setting Powered False 11:42:01.776782 bus /gobi_0: Setting Powered False 11:42:02.889972 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:42:04.034392 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:04.046264 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:42:04.107474 tst iperf3.py: using LAC 33700 11:42:04.230662 tst iperf3.py: using RAC 40 11:42:04.355196 tst iperf3.py: using CellId 33700 11:42:04.479513 tst iperf3.py: using BVCI 33701 11:42:04.594697 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:04.605842 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:04.616596 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:04.627403 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:04.638348 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:04.649161 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:04.660687 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:04.671464 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:04.682357 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:04.804143 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:42:05.031740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:05.370109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15177): Launched 11:42:05.664781 run iperf3-srv_10.42.42.10(pid=15178): Launched 11:42:05.792607 tst iperf3.py:8: start network... 11:42:06.019047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:06.538722 run create_hlr_db(pid=15179): Launched 11:42:06.667716 bus /gobi_6: Setting Powered False 11:42:07.733719 run create_hlr_db(pid=15179): Terminated: ok {rc=0} 11:42:08.200454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15181): Launched 11:42:08.536830 run osmo-hlr_10.42.42.2(pid=15182): Launched 11:42:08.664396 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:09.241813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15184): Launched 11:42:09.577374 run osmo-stp_10.42.42.5(pid=15185): Launched 11:42:09.707167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:10.287498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15187): Launched 11:42:10.415842 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:10.699322 run patchelf(pid=15188): Launched 11:42:10.885416 run osmo-stp_10.42.42.5(pid=15185): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15185)] 11:42:11.027228 run osmo-stp_10.42.42.5(pid=15185): stdout: | (launched: 2022-12-13_11:42:09.515071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:11.170464 run osmo-stp_10.42.42.5(pid=15185): stderr: | 20221213114209712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114209712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114209712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114209713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114209713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114209713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114209713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:11.313791 run osmo-stp_10.42.42.5(pid=15185): stdout: | (launched: 2022-12-13_11:42:09.515071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:11.450487 run osmo-stp_10.42.42.5(pid=15185): stderr: | 20221213114209712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114209712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114209712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114209713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114209713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114209713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114209713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:11.612632 run patchelf(pid=15188): Terminating (SIGINT) 11:42:11.800303 run patchelf(pid=15188): Terminated: ok {rc=0} 11:42:11.935608 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15185): Process ended prematurely: osmo-stp_10.42.42.5(pid=15185) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15185)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 11:42:11.946116 tst iperf3.py:8: Test FAILED (7.9 sec) 11:42:11.974777 run osmo-hlr_10.42.42.2(pid=15182): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15182)] 11:42:12.025610 run osmo-hlr_10.42.42.2(pid=15182): stdout: | (launched: 2022-12-13_11:42:08.474670) 11:42:12.078000 run osmo-hlr_10.42.42.2(pid=15182): stderr: | 20221213114208678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114208678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114208678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114208678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114208678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114208678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114208692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114208702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114208702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114208702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:12.130713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15177): Terminating (SIGTERM) 11:42:12.173126 run iperf3-srv_10.42.42.10(pid=15178): Terminating (SIGTERM) 11:42:12.215293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15181): Terminating (SIGTERM) 11:42:12.258259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15184): Terminating (SIGTERM) 11:42:12.300918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15187): Terminating (SIGTERM) 11:42:12.344066 --- ParallelTerminationStrategy: PID 15177 died... 11:42:12.364509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15177): Terminated: ok {rc=0} 11:42:12.412094 --- ParallelTerminationStrategy: PID 15178 died... 11:42:12.432147 run iperf3-srv_10.42.42.10(pid=15178): Terminated {rc=256} 11:42:12.478705 --- ParallelTerminationStrategy: PID 15181 died... 11:42:12.498841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15181): Terminated: ok {rc=0} 11:42:12.545567 --- ParallelTerminationStrategy: PID 15184 died... 11:42:12.565676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15184): Terminated: ok {rc=0} 11:42:12.612240 --- ParallelTerminationStrategy: PID 15187 died... 11:42:12.632422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15187): Terminated: ok {rc=0} 11:42:12.721977 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:42:13.870825 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:13.882770 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:42:13.941215 tst iperf3m4.py: using LAC 33701 11:42:14.064687 tst iperf3m4.py: using RAC 41 11:42:14.187806 tst iperf3m4.py: using CellId 33701 11:42:14.311237 tst iperf3m4.py: using BVCI 33702 11:42:14.435382 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:14.447164 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:14.458564 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:14.470117 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:14.482349 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:14.494762 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:14.507299 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:14.519427 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:14.531746 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:14.651750 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:14.776773 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:14.895078 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:15.017286 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:42:15.244702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:15.582067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15189): Launched 11:42:15.887564 run iperf3-srv_10.42.42.10(pid=15190): Launched 11:42:16.049414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:42:16.280229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:16.625709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15191): Launched 11:42:17.001052 run iperf3-srv_10.42.42.10(pid=15192): Launched 11:42:17.143580 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:42:17.356452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:17.672496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15193): Launched 11:42:17.948485 run iperf3-srv_10.42.42.10(pid=15194): Launched 11:42:18.066084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:42:18.275341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:18.590694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15195): Launched 11:42:18.863656 run iperf3-srv_10.42.42.10(pid=15196): Launched 11:42:18.980389 tst iperf3m4.py:8: start network... 11:42:19.189448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:19.674505 run create_hlr_db(pid=15197): Launched 11:42:19.802327 bus /gobi_6: Setting Powered False 11:42:20.864573 run create_hlr_db(pid=15197): Terminated: ok {rc=0} 11:42:21.300335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15199): Launched 11:42:21.615752 run osmo-hlr_10.42.42.2(pid=15200): Launched 11:42:21.735449 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:22.293579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15202): Launched 11:42:22.609426 run osmo-stp_10.42.42.5(pid=15203): Launched 11:42:22.727986 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:23.266446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15205): Launched 11:42:23.387038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:23.652180 run patchelf(pid=15206): Launched 11:42:23.827575 run osmo-stp_10.42.42.5(pid=15203): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15203)] 11:42:23.959911 run osmo-stp_10.42.42.5(pid=15203): stdout: | (launched: 2022-12-13_11:42:22.550263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:24.094310 run osmo-stp_10.42.42.5(pid=15203): stderr: | 20221213114222727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114222727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114222727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114222728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114222728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114222728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114222728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:24.228197 run osmo-stp_10.42.42.5(pid=15203): stdout: | (launched: 2022-12-13_11:42:22.550263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:24.355719 run osmo-stp_10.42.42.5(pid=15203): stderr: | 20221213114222727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114222727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114222727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114222728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114222728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114222728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114222728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:24.507689 run patchelf(pid=15206): Terminating (SIGINT) 11:42:24.682292 run patchelf(pid=15206): Terminated: ok {rc=0} 11:42:24.808379 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15203): Process ended prematurely: osmo-stp_10.42.42.5(pid=15203) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15203)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:42:24.818279 tst iperf3m4.py:8: Test FAILED (11.0 sec) 11:42:24.845866 run osmo-hlr_10.42.42.2(pid=15200): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15200)] 11:42:24.893568 run osmo-hlr_10.42.42.2(pid=15200): stdout: | (launched: 2022-12-13_11:42:21.556511) 11:42:24.942921 run osmo-hlr_10.42.42.2(pid=15200): stderr: | 20221213114221742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114221742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114221742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114221742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114221742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114221742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114221754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114221763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114221764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114221764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:24.992692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15189): Terminating (SIGTERM) 11:42:25.032464 run iperf3-srv_10.42.42.10(pid=15190): Terminating (SIGTERM) 11:42:25.072144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15191): Terminating (SIGTERM) 11:42:25.112241 run iperf3-srv_10.42.42.10(pid=15192): Terminating (SIGTERM) 11:42:25.152182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15193): Terminating (SIGTERM) 11:42:25.191946 run iperf3-srv_10.42.42.10(pid=15194): Terminating (SIGTERM) 11:42:25.231779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15195): Terminating (SIGTERM) 11:42:25.271696 run iperf3-srv_10.42.42.10(pid=15196): Terminating (SIGTERM) 11:42:25.311581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15199): Terminating (SIGTERM) 11:42:25.351926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15202): Terminating (SIGTERM) 11:42:25.391779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15205): Terminating (SIGTERM) 11:42:25.432057 --- ParallelTerminationStrategy: PID 15189 died... 11:42:25.451593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15189): Terminated: ok {rc=0} 11:42:25.495950 --- ParallelTerminationStrategy: PID 15190 died... 11:42:25.514635 run iperf3-srv_10.42.42.10(pid=15190): Terminated {rc=256} 11:42:25.558728 --- ParallelTerminationStrategy: PID 15191 died... 11:42:25.577678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15191): Terminated: ok {rc=0} 11:42:25.621678 --- ParallelTerminationStrategy: PID 15192 died... 11:42:25.640305 run iperf3-srv_10.42.42.10(pid=15192): Terminated {rc=256} 11:42:25.684720 --- ParallelTerminationStrategy: PID 15193 died... 11:42:25.703924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15193): Terminated: ok {rc=0} 11:42:25.748086 --- ParallelTerminationStrategy: PID 15194 died... 11:42:25.766874 run iperf3-srv_10.42.42.10(pid=15194): Terminated {rc=256} 11:42:25.811076 --- ParallelTerminationStrategy: PID 15195 died... 11:42:25.829857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15195): Terminated: ok {rc=0} 11:42:25.873961 --- ParallelTerminationStrategy: PID 15196 died... 11:42:25.892657 run iperf3-srv_10.42.42.10(pid=15196): Terminated {rc=256} 11:42:25.936795 --- ParallelTerminationStrategy: PID 15199 died... 11:42:25.955634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15199): Terminated: ok {rc=0} 11:42:25.999643 --- ParallelTerminationStrategy: PID 15202 died... 11:42:26.018404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15202): Terminated: ok {rc=0} 11:42:26.062382 --- ParallelTerminationStrategy: PID 15205 died... 11:42:26.080903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15205): Terminated: ok {rc=0} 11:42:26.166792 bus /gobi_4: Setting Powered False 11:42:27.266334 bus /gobi_4: Setting Powered False 11:42:28.379809 bus /gobi_1: Setting Powered False 11:42:29.478866 bus /gobi_1: Setting Powered False 11:42:30.595341 bus /gobi_0: Setting Powered False 11:42:31.719280 bus /gobi_0: Setting Powered False 11:42:32.846489 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:42:33.948219 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:33.960175 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:42:34.019585 tst ping.py: using LAC 33702 11:42:34.145000 tst ping.py: using RAC 42 11:42:34.265531 tst ping.py: using CellId 33702 11:42:34.386601 tst ping.py: using BVCI 33703 11:42:34.499027 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:34.510251 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:34.521211 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:34.531897 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:34.542785 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:34.553523 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:34.565365 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:34.576243 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:34.691581 tst ping.py:19: start network... 11:42:34.897702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:35.373301 run create_hlr_db(pid=15207): Launched 11:42:35.497492 bus /gobi_6: Setting Powered False 11:42:36.558746 run create_hlr_db(pid=15207): Terminated: ok {rc=0} 11:42:36.988787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15209): Launched 11:42:37.298642 run osmo-hlr_10.42.42.2(pid=15210): Launched 11:42:37.417558 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:37.973597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15212): Launched 11:42:38.282637 run osmo-stp_10.42.42.5(pid=15213): Launched 11:42:38.402110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:38.948664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15215): Launched 11:42:39.066612 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:39.326563 run patchelf(pid=15216): Launched 11:42:39.498233 run osmo-stp_10.42.42.5(pid=15213): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15213)] 11:42:39.627597 run osmo-stp_10.42.42.5(pid=15213): stdout: | (launched: 2022-12-13_11:42:38.224017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:39.758889 run osmo-stp_10.42.42.5(pid=15213): stderr: | 20221213114238398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114238399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114238399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114238399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114238400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114238400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114238400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:39.889837 run osmo-stp_10.42.42.5(pid=15213): stdout: | (launched: 2022-12-13_11:42:38.224017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:40.015107 run osmo-stp_10.42.42.5(pid=15213): stderr: | 20221213114238398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114238399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114238399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114238399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114238400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114238400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114238400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:40.163357 run patchelf(pid=15216): Terminating (SIGINT) 11:42:40.334516 run patchelf(pid=15216): Terminated: ok {rc=0} 11:42:40.457721 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15213): Process ended prematurely: osmo-stp_10.42.42.5(pid=15213) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15213)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 11:42:40.466706 tst ping.py:22: Test FAILED (6.5 sec) 11:42:40.493707 run osmo-hlr_10.42.42.2(pid=15210): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15210)] 11:42:40.542702 run osmo-hlr_10.42.42.2(pid=15210): stdout: | (launched: 2022-12-13_11:42:37.240078) 11:42:40.592678 run osmo-hlr_10.42.42.2(pid=15210): stderr: | 20221213114237418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114237418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114237418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114237418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114237418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114237418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114237430 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114237438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114237438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114237438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:40.643213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15209): Terminating (SIGTERM) 11:42:40.683612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15212): Terminating (SIGTERM) 11:42:40.724274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15215): Terminating (SIGTERM) 11:42:40.764764 --- ParallelTerminationStrategy: PID 15209 died... 11:42:40.784208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15209): Terminated: ok {rc=0} 11:42:40.828879 --- ParallelTerminationStrategy: PID 15212 died... 11:42:40.847867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15212): Terminated: ok {rc=0} 11:42:40.892369 --- ParallelTerminationStrategy: PID 15215 died... 11:42:40.911301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15215): Terminated: ok {rc=0} 11:42:40.998189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:42:42.087880 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:42.099574 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:42:42.172269 tst ping_idle_ping.py: using LAC 33703 11:42:42.297658 tst ping_idle_ping.py: using RAC 43 11:42:42.419950 tst ping_idle_ping.py: using CellId 33703 11:42:42.542538 tst ping_idle_ping.py: using BVCI 33704 11:42:42.657215 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:42.668256 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:42.679097 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:42.689931 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:42.701124 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:42.712529 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:42.724080 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:42.735394 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:42.851622 tst ping_idle_ping.py:24: start network... 11:42:43.058019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:43.539326 run create_hlr_db(pid=15217): Launched 11:42:43.666074 bus /gobi_6: Setting Powered False 11:42:44.727922 run create_hlr_db(pid=15217): Terminated: ok {rc=0} 11:42:45.179196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15219): Launched 11:42:45.512172 run osmo-hlr_10.42.42.2(pid=15220): Launched 11:42:45.640683 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:46.210738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15222): Launched 11:42:46.541912 run osmo-stp_10.42.42.5(pid=15223): Launched 11:42:46.716478 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:47.437932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15225): Launched 11:42:47.557438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:47.819477 run patchelf(pid=15226): Launched 11:42:47.991837 run osmo-stp_10.42.42.5(pid=15223): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15223)] 11:42:48.121888 run osmo-stp_10.42.42.5(pid=15223): stdout: | (launched: 2022-12-13_11:42:46.481285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:48.253193 run osmo-stp_10.42.42.5(pid=15223): stderr: | 20221213114246845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114246845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114246845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114246846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114246846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114246846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114246846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:48.384768 run osmo-stp_10.42.42.5(pid=15223): stdout: | (launched: 2022-12-13_11:42:46.481285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:48.510452 run osmo-stp_10.42.42.5(pid=15223): stderr: | 20221213114246845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114246845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114246845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114246846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114246846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114246846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114246846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:48.660030 run patchelf(pid=15226): Terminating (SIGINT) 11:42:48.831879 run patchelf(pid=15226): Terminated: ok {rc=0} 11:42:48.955755 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15223): Process ended prematurely: osmo-stp_10.42.42.5(pid=15223) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15223)] [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:42:48.965436 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 11:42:48.992350 run osmo-hlr_10.42.42.2(pid=15220): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15220)] 11:42:49.040192 run osmo-hlr_10.42.42.2(pid=15220): stdout: | (launched: 2022-12-13_11:42:45.450474) 11:42:49.089987 run osmo-hlr_10.42.42.2(pid=15220): stderr: | 20221213114245651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114245651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114245651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114245652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114245652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114245652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114245664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114245672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114245672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114245672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:49.140365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15219): Terminating (SIGTERM) 11:42:49.180352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15222): Terminating (SIGTERM) 11:42:49.220488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15225): Terminating (SIGTERM) 11:42:49.260900 --- ParallelTerminationStrategy: PID 15219 died... 11:42:49.280210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15219): Terminated: ok {rc=0} 11:42:49.324380 --- ParallelTerminationStrategy: PID 15222 died... 11:42:49.343208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15222): Terminated: ok {rc=0} 11:42:49.387261 --- ParallelTerminationStrategy: PID 15225 died... 11:42:49.406099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15225): Terminated: ok {rc=0} 11:42:49.492437 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:42:50.788476 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:42:50.795287 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:42:50.816172 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:42:50.852486 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:42:50.906669 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:42:50.929370 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:42:50.964909 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:42:51.524192 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:42:51.530402 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:51.542240 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:42:51.601072 tst switch_tch_pdch.py: using LAC 33704 11:42:51.724852 tst switch_tch_pdch.py: using RAC 44 11:42:51.846648 tst switch_tch_pdch.py: using CellId 33704 11:42:51.968444 tst switch_tch_pdch.py: using BVCI 33705 11:42:52.080920 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:52.092330 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:52.103410 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:52.114480 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:52.125429 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:52.136452 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:52.147624 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:42:52.158698 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:42:52.273684 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:42:52.389974 tst switch_tch_pdch.py:51: start network... 11:42:52.595592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:53.072713 run create_hlr_db(pid=15230): Launched 11:42:53.199761 bus /gobi_6: Setting Powered False 11:42:54.260445 run create_hlr_db(pid=15230): Terminated: ok {rc=0} 11:42:54.690731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15232): Launched 11:42:54.999217 run osmo-hlr_10.42.42.2(pid=15233): Launched 11:42:55.117065 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:55.644676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15235): Launched 11:42:55.953313 run osmo-stp_10.42.42.5(pid=15236): Launched 11:42:56.073073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:56.605630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15238): Launched 11:42:56.723730 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:56.984474 run patchelf(pid=15239): Launched 11:42:57.156433 run osmo-stp_10.42.42.5(pid=15236): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15236)] 11:42:57.286231 run osmo-stp_10.42.42.5(pid=15236): stdout: | (launched: 2022-12-13_11:42:55.895301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:57.417277 run osmo-stp_10.42.42.5(pid=15236): stderr: | 20221213114256070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114256070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114256070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114256071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114256071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114256071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114256071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:57.548231 run osmo-stp_10.42.42.5(pid=15236): stdout: | (launched: 2022-12-13_11:42:55.895301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:57.672746 run osmo-stp_10.42.42.5(pid=15236): stderr: | 20221213114256070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114256070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114256070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114256071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114256071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114256071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114256071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:57.821410 run patchelf(pid=15239): Terminating (SIGINT) 11:42:57.992541 run patchelf(pid=15239): Terminated: ok {rc=0} 11:42:58.116111 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15236): Process ended prematurely: osmo-stp_10.42.42.5(pid=15236) [trial-2389↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15236)] [trial-2389↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:42:58.125239 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 11:42:58.152248 run osmo-hlr_10.42.42.2(pid=15233): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15233)] 11:42:58.200248 run osmo-hlr_10.42.42.2(pid=15233): stdout: | (launched: 2022-12-13_11:42:54.941232) 11:42:58.250119 run osmo-hlr_10.42.42.2(pid=15233): stderr: | 20221213114255122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114255122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114255122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114255122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114255122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114255122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114255134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114255143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114255144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114255144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:58.300130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15232): Terminating (SIGTERM) 11:42:58.340237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15235): Terminating (SIGTERM) 11:42:58.380394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15238): Terminating (SIGTERM) 11:42:58.420592 --- ParallelTerminationStrategy: PID 15232 died... 11:42:58.440228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15232): Terminated: ok {rc=0} 11:42:58.485077 --- ParallelTerminationStrategy: PID 15235 died... 11:42:58.504061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15235): Terminated: ok {rc=0} 11:42:58.548469 --- ParallelTerminationStrategy: PID 15238 died... 11:42:58.567551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15238): Terminated: ok {rc=0} 11:42:58.654226 bus /gobi_0: Setting Powered False 11:42:59.753333 bus /gobi_0: Setting Powered False 11:43:00.866398 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:43:02.149269 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:02.159775 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:43:02.187740 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:43:02.233458 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:43:02.287979 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:43:02.311178 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:43:02.350167 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:43:02.902768 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:43:02.908405 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:02.920010 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:43:02.979040 tst switch_tch_pdch.py: using LAC 33705 11:43:03.108890 tst switch_tch_pdch.py: using RAC 45 11:43:03.238539 tst switch_tch_pdch.py: using CellId 33705 11:43:03.369019 tst switch_tch_pdch.py: using BVCI 33706 11:43:03.489837 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:03.501526 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:03.512877 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:03.524212 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:03.535963 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:03.547648 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:03.559571 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:03.571398 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:43:03.692313 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:43:03.814462 tst switch_tch_pdch.py:51: start network... 11:43:04.037311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:04.518749 run create_hlr_db(pid=15243): Launched 11:43:04.643327 bus /gobi_6: Setting Powered False 11:43:05.708307 run create_hlr_db(pid=15243): Terminated: ok {rc=0} 11:43:06.123266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15245): Launched 11:43:06.433790 run osmo-hlr_10.42.42.2(pid=15246): Launched 11:43:06.553842 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:07.060812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15248): Launched 11:43:07.369598 run osmo-stp_10.42.42.5(pid=15249): Launched 11:43:07.486993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:07.996184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15251): Launched 11:43:08.115292 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:08.375594 run patchelf(pid=15252): Launched 11:43:08.547198 run osmo-stp_10.42.42.5(pid=15249): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15249)] 11:43:08.677210 run osmo-stp_10.42.42.5(pid=15249): stdout: | (launched: 2022-12-13_11:43:07.311396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:08.809609 run osmo-stp_10.42.42.5(pid=15249): stderr: | 20221213114307485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114307486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114307487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114307487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114307487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114307487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114307488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:08.941192 run osmo-stp_10.42.42.5(pid=15249): stdout: | (launched: 2022-12-13_11:43:07.311396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:09.066589 run osmo-stp_10.42.42.5(pid=15249): stderr: | 20221213114307485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114307486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114307487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114307487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114307487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114307487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114307488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:09.215893 run patchelf(pid=15252): Terminating (SIGINT) 11:43:09.387416 run patchelf(pid=15252): Terminated: ok {rc=0} 11:43:09.510772 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15249): Process ended prematurely: osmo-stp_10.42.42.5(pid=15249) [trial-2389↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15249)] [trial-2389↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:43:09.519877 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 11:43:09.546988 run osmo-hlr_10.42.42.2(pid=15246): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15246)] 11:43:09.595176 run osmo-hlr_10.42.42.2(pid=15246): stdout: | (launched: 2022-12-13_11:43:06.375729) 11:43:09.645159 run osmo-hlr_10.42.42.2(pid=15246): stderr: | 20221213114306555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114306555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114306555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114306555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114306555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114306555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114306567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114306577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114306577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114306578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:09.695544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15245): Terminating (SIGTERM) 11:43:09.735738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15248): Terminating (SIGTERM) 11:43:09.775896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15251): Terminating (SIGTERM) 11:43:09.816422 --- ParallelTerminationStrategy: PID 15245 died... 11:43:09.836099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15245): Terminated: ok {rc=0} 11:43:09.880710 --- ParallelTerminationStrategy: PID 15248 died... 11:43:09.899800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15248): Terminated: ok {rc=0} 11:43:09.944147 --- ParallelTerminationStrategy: PID 15251 died... 11:43:09.963164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15251): Terminated: ok {rc=0} 11:43:10.047146 bus /gobi_0: Setting Powered False 11:43:11.144282 bus /gobi_0: Setting Powered False 11:43:12.261040 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_sms:oc2g --------------------------------------------------------------------- 11:43:13.502599 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:13.506269 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 11:43:13.526899 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 11:43:13.533734 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 11:43:13.586462 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 11:43:13.607359 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 11:43:13.614201 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 11:43:14.154145 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 11:43:14.159215 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 11:43:14.170173 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 11:43:14.204748 tst mo_mt_sms.py: using LAC 33706 11:43:14.334332 tst mo_mt_sms.py: using RAC 46 11:43:14.462510 tst mo_mt_sms.py: using CellId 33706 11:43:14.596907 tst mo_mt_sms.py: using BVCI 33707 11:43:14.718350 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 11:43:14.834086 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 11:43:14.948437 tst mo_mt_sms.py:9: start nitb and bts... 11:43:15.154391 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:43:15.780096 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15256): Launched 11:43:16.104802 run osmo-nitb_10.42.42.2(pid=15257): Launched 11:43:16.291445 run osmo-nitb_10.42.42.2(pid=15257): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15257)] 11:43:16.430874 run osmo-nitb_10.42.42.2(pid=15257): stdout: | (launched: 2022-12-13_11:43:16.042456) 11:43:16.573285 run osmo-nitb_10.42.42.2(pid=15257): stderr: | (launched: 2022-12-13_11:43:16.090124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:43:16.714409 run osmo-nitb_10.42.42.2(pid=15257): stdout: | (launched: 2022-12-13_11:43:16.042456) 11:43:16.850564 run osmo-nitb_10.42.42.2(pid=15257): stderr: | (launched: 2022-12-13_11:43:16.090124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15257): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15257) [trial-2389↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15257)] 11:43:17.236083 tst osmo-nitb_10.42.42.2(pid=15257): stdout: | (launched: 2022-12-13_11:43:16.042456) 11:43:17.370491 tst osmo-nitb_10.42.42.2(pid=15257): stderr: | (launched: 2022-12-13_11:43:16.090124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:43:17.516466 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15257): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15257) [trial-2389↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15257)] [trial-2389↪nitb_sms:oc2g↪mo_mt_sms.py:11] 11:43:17.525243 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 11:43:17.531977 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15256): Terminating (SIGTERM) 11:43:17.740250 --- ParallelTerminationStrategy: PID 15256 died... 11:43:17.760929 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15256): Terminated: ok {rc=0} 11:43:17.848192 bus /sierra_3: Setting Powered False 11:43:18.949214 bus /sierra_3: Setting Powered False 11:43:20.064720 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 sms:oc2g --------------------------------------------------------------------- 11:43:21.245929 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:21.250039 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 11:43:21.270744 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 11:43:21.297929 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 11:43:21.349740 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 11:43:21.370603 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 11:43:21.397531 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 11:43:21.944426 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 sms:oc2g mo_mt_sms.py ---------------------------------------------- 11:43:21.949618 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:43:21.960282 tst sms:oc2g: Using 1 x bts (candidates: 1) 11:43:21.995157 tst mo_mt_sms.py: using LAC 33707 11:43:22.125063 tst mo_mt_sms.py: using RAC 47 11:43:22.253120 tst mo_mt_sms.py: using CellId 33707 11:43:22.383011 tst mo_mt_sms.py: using BVCI 33708 11:43:22.503448 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:43:22.514800 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:43:22.526007 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:43:22.537056 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:43:22.548341 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:43:22.559713 tst sms:oc2g: Using 1 x modem (candidates: 2) 11:43:22.679084 tst sms:oc2g: Using 1 x modem (candidates: 2) 11:43:22.796609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:23.276237 run create_hlr_db(pid=15261): Launched 11:43:23.403381 bus /sierra_2: Setting Powered False 11:43:24.464318 run create_hlr_db(pid=15261): Terminated: ok {rc=0} 11:43:24.895287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15263): Launched 11:43:25.207556 run osmo-hlr_10.42.42.2(pid=15264): Launched 11:43:25.326245 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:25.857252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15266): Launched 11:43:26.166814 run osmo-stp_10.42.42.5(pid=15267): Launched 11:43:26.285268 run osmo-msc_10.42.42.6: Starting osmo-msc 11:43:26.842415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15269): Launched 11:43:27.151748 run osmo-msc_10.42.42.6(pid=15270): Launched 11:43:27.324685 run osmo-stp_10.42.42.5(pid=15267): ERR: Terminated: ERROR {rc=1} [trial-2389↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15267)] 11:43:27.454027 run osmo-stp_10.42.42.5(pid=15267): stdout: | (launched: 2022-12-13_11:43:26.108600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:27.583611 run osmo-stp_10.42.42.5(pid=15267): stderr: | 20221213114326281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114326282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114326282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114326282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114326283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114326283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114326283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:27.710849 run osmo-stp_10.42.42.5(pid=15267): stdout: | (launched: 2022-12-13_11:43:26.108600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:27.832343 run osmo-stp_10.42.42.5(pid=15267): stderr: | 20221213114326281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114326282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114326282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114326282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114326283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114326283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114326283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:27.978235 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15267): Process ended prematurely: osmo-stp_10.42.42.5(pid=15267) [trial-2389↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15267)] [trial-2389↪sms:oc2g↪mo_mt_sms.py:16] 11:43:27.986690 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 11:43:28.012698 run osmo-hlr_10.42.42.2(pid=15264): ERR: Terminated: ERROR {rc=237} [trial-2389↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15264)] 11:43:28.061257 run osmo-hlr_10.42.42.2(pid=15264): stdout: | (launched: 2022-12-13_11:43:25.148860) 11:43:28.111339 run osmo-hlr_10.42.42.2(pid=15264): stderr: | 20221213114325329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114325330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114325330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114325330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114325330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114325330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114325342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114325351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114325351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114325351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:28.181226 run osmo-msc_10.42.42.6(pid=15270): ERR: Terminated: ERROR {rc=2} [trial-2389↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15270)] 11:43:28.229511 run osmo-msc_10.42.42.6(pid=15270): stdout: | (launched: 2022-12-13_11:43:27.093243) 11:43:28.279588 run osmo-msc_10.42.42.6(pid=15270): stderr: | 20221213114327370 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114327370 DLGLOBAL DEBUG validating counter group 0x7fee8e99bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114327370 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114327370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114327370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114327371 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114327372 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114327373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114327373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114327373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:43:28.330101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15263): Terminating (SIGTERM) 11:43:28.370272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15266): Terminating (SIGTERM) 11:43:28.410355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15269): Terminating (SIGTERM) 11:43:28.451030 --- ParallelTerminationStrategy: PID 15263 died... 11:43:28.470551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15263): Terminated: ok {rc=0} 11:43:28.515007 --- ParallelTerminationStrategy: PID 15266 died... 11:43:28.533880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15266): Terminated: ok {rc=0} 11:43:28.578277 --- ParallelTerminationStrategy: PID 15269 died... 11:43:28.597208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15269): Terminated: ok {rc=0} 11:43:28.684174 bus /sierra_3: Setting Powered False 11:43:29.785471 bus /sierra_3: Setting Powered False 11:43:30.906199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_ussd:oc2g --------------------------------------------------------------------- 11:43:32.139788 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:32.143625 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 11:43:32.164887 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 11:43:32.172548 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 11:43:32.213878 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 11:43:32.246239 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 11:43:32.253562 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 11:43:32.758959 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 11:43:32.764451 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 11:43:32.775767 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 11:43:32.814699 tst assert_extension.py: using LAC 33708 11:43:32.935625 tst assert_extension.py: using RAC 48 11:43:33.055288 tst assert_extension.py: using CellId 33708 11:43:33.174841 tst assert_extension.py: using BVCI 33709 11:43:33.287461 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 11:43:33.408624 tst assert_extension.py:10: start nitb and bts... 11:43:33.632903 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:43:34.303705 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15275): Launched 11:43:34.634329 run osmo-nitb_10.42.42.2(pid=15276): Launched 11:43:34.818055 run osmo-nitb_10.42.42.2(pid=15276): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15276)] 11:43:34.965187 run osmo-nitb_10.42.42.2(pid=15276): stdout: | (launched: 2022-12-13_11:43:34.572518) 11:43:35.114226 run osmo-nitb_10.42.42.2(pid=15276): stderr: | (launched: 2022-12-13_11:43:34.621555) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:43:35.263024 run osmo-nitb_10.42.42.2(pid=15276): stdout: | (launched: 2022-12-13_11:43:34.572518) 11:43:35.405551 run osmo-nitb_10.42.42.2(pid=15276): stderr: | (launched: 2022-12-13_11:43:34.621555) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15276): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15276) [trial-2389↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15276)] 11:43:35.760415 tst osmo-nitb_10.42.42.2(pid=15276): stdout: | (launched: 2022-12-13_11:43:34.572518) 11:43:35.893129 tst osmo-nitb_10.42.42.2(pid=15276): stderr: | (launched: 2022-12-13_11:43:34.621555) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:43:36.050475 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15276): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15276) [trial-2389↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15276)] [trial-2389↪nitb_ussd:oc2g↪assert_extension.py:12] 11:43:36.059583 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:43:36.066894 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15275): Terminating (SIGTERM) 11:43:36.278885 --- ParallelTerminationStrategy: PID 15275 died... 11:43:36.301096 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15275): Terminated: ok {rc=0} 11:43:36.391067 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 ussd:oc2g --------------------------------------------------------------------- 11:43:37.559752 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:37.563957 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 11:43:37.585545 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 11:43:37.614378 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 11:43:37.651202 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 11:43:37.673035 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 11:43:37.700529 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 11:43:38.227548 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 ussd:oc2g assert_extension.py ---------------------------------------------- 11:43:38.232754 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:43:38.243549 tst ussd:oc2g: Using 1 x bts (candidates: 1) 11:43:38.277336 tst assert_extension.py: using LAC 33709 11:43:38.406345 tst assert_extension.py: using RAC 49 11:43:38.537445 tst assert_extension.py: using CellId 33709 11:43:38.666432 tst assert_extension.py: using BVCI 33710 11:43:38.788003 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:43:38.799108 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:43:38.810235 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:43:38.821147 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:43:38.832485 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:43:38.843737 tst ussd:oc2g: Using 1 x modem (candidates: 1) 11:43:38.963766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:39.474608 run create_hlr_db(pid=15280): Launched 11:43:39.599654 bus /sierra_2: Setting Powered False 11:43:40.664367 run create_hlr_db(pid=15280): Terminated: ok {rc=0} 11:43:41.106602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15282): Launched 11:43:41.417394 run osmo-hlr_10.42.42.2(pid=15283): Launched 11:43:41.535807 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:42.071924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15285): Launched 11:43:42.382541 run osmo-stp_10.42.42.5(pid=15286): Launched 11:43:42.501318 run osmo-msc_10.42.42.6: Starting osmo-msc 11:43:43.056170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15288): Launched 11:43:43.366673 run osmo-msc_10.42.42.6(pid=15289): Launched 11:43:43.538873 run osmo-stp_10.42.42.5(pid=15286): ERR: Terminated: ERROR {rc=1} [trial-2389↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15286)] 11:43:43.668620 run osmo-stp_10.42.42.5(pid=15286): stdout: | (launched: 2022-12-13_11:43:42.324188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:43.797552 run osmo-stp_10.42.42.5(pid=15286): stderr: | 20221213114342497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114342497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114342498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114342498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114342500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114342500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114342500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:43.925196 run osmo-stp_10.42.42.5(pid=15286): stdout: | (launched: 2022-12-13_11:43:42.324188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:44.046927 run osmo-stp_10.42.42.5(pid=15286): stderr: | 20221213114342497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114342497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114342498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114342498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114342500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114342500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114342500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:44.192915 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15286): Process ended prematurely: osmo-stp_10.42.42.5(pid=15286) [trial-2389↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15286)] [trial-2389↪ussd:oc2g↪assert_extension.py:17] 11:43:44.201582 tst assert_extension.py:17: Test FAILED (6.0 sec) 11:43:44.228029 run osmo-hlr_10.42.42.2(pid=15283): ERR: Terminated: ERROR {rc=237} [trial-2389↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15283)] 11:43:44.276734 run osmo-hlr_10.42.42.2(pid=15283): stdout: | (launched: 2022-12-13_11:43:41.358719) 11:43:44.326969 run osmo-hlr_10.42.42.2(pid=15283): stderr: | 20221213114341539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114341539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114341539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114341539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114341539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114341539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114341551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114341560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114341560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114341560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:44.396147 run osmo-msc_10.42.42.6(pid=15289): ERR: Terminated: ERROR {rc=2} [trial-2389↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15289)] 11:43:44.444080 run osmo-msc_10.42.42.6(pid=15289): stdout: | (launched: 2022-12-13_11:43:43.308254) 11:43:44.493631 run osmo-msc_10.42.42.6(pid=15289): stderr: | 20221213114343585 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114343585 DLGLOBAL DEBUG validating counter group 0x7f121aeaac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114343585 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114343585 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114343586 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114343586 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114343587 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114343588 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114343588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114343588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:43:44.543702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15282): Terminating (SIGTERM) 11:43:44.583503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15285): Terminating (SIGTERM) 11:43:44.623235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15288): Terminating (SIGTERM) 11:43:44.663217 --- ParallelTerminationStrategy: PID 15282 died... 11:43:44.682588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15282): Terminated: ok {rc=0} 11:43:44.726820 --- ParallelTerminationStrategy: PID 15285 died... 11:43:44.745741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15285): Terminated: ok {rc=0} 11:43:44.789829 --- ParallelTerminationStrategy: PID 15288 died... 11:43:44.808757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15288): Terminated: ok {rc=0} 11:43:44.895279 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:43:46.097755 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:46.107932 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:43:46.135108 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:43:46.170180 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:43:46.228691 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:43:46.266109 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:43:46.298105 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:43:46.832786 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:43:46.891585 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:46.904245 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:43:46.965543 tst mo_mt_call.py: using LAC 33710 11:43:47.131886 tst mo_mt_call.py: using RAC 50 11:43:47.280867 tst mo_mt_call.py: using CellId 33710 11:43:47.407095 tst mo_mt_call.py: using BVCI 33711 11:43:47.522662 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:47.534041 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:47.545151 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:47.556179 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:47.567508 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:47.578705 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:43:47.701299 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:43:47.823445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:48.344773 run create_hlr_db(pid=15294): Launched 11:43:48.474592 bus /sierra_2: Setting Powered False 11:43:49.540853 run create_hlr_db(pid=15294): Terminated: ok {rc=0} 11:43:49.991208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15296): Launched 11:43:50.308215 run osmo-hlr_10.42.42.2(pid=15297): Launched 11:43:50.428645 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:50.974473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15299): Launched 11:43:51.289747 run osmo-stp_10.42.42.5(pid=15300): Launched 11:43:51.410310 run osmo-msc_10.42.42.6: Starting osmo-msc 11:43:51.991479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15302): Launched 11:43:52.307385 run osmo-msc_10.42.42.6(pid=15303): Launched 11:43:52.483976 run osmo-stp_10.42.42.5(pid=15300): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15300)] 11:43:52.616353 run osmo-stp_10.42.42.5(pid=15300): stdout: | (launched: 2022-12-13_11:43:51.230512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:52.748082 run osmo-stp_10.42.42.5(pid=15300): stderr: | 20221213114351406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114351406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114351406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114351406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114351407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114351407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114351407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:52.877736 run osmo-stp_10.42.42.5(pid=15300): stdout: | (launched: 2022-12-13_11:43:51.230512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:53.001498 run osmo-stp_10.42.42.5(pid=15300): stderr: | 20221213114351406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114351406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114351406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114351406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114351407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114351407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114351407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:53.150939 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15300): Process ended prematurely: osmo-stp_10.42.42.5(pid=15300) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15300)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:43:53.159981 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:43:53.186592 run osmo-hlr_10.42.42.2(pid=15297): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15297)] 11:43:53.234423 run osmo-hlr_10.42.42.2(pid=15297): stdout: | (launched: 2022-12-13_11:43:50.249538) 11:43:53.283836 run osmo-hlr_10.42.42.2(pid=15297): stderr: | 20221213114350430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114350431 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114350431 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114350431 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114350431 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114350431 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114350443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114350451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114350451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114350451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:53.352992 run osmo-msc_10.42.42.6(pid=15303): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15303)] 11:43:53.400520 run osmo-msc_10.42.42.6(pid=15303): stdout: | (launched: 2022-12-13_11:43:52.248006) 11:43:53.449914 run osmo-msc_10.42.42.6(pid=15303): stderr: | 20221213114352526 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114352526 DLGLOBAL DEBUG validating counter group 0x7f3e0be98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114352526 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114352526 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114352526 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114352527 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114352530 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114352530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114352530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114352531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:43:53.499779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15296): Terminating (SIGTERM) 11:43:53.539703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15299): Terminating (SIGTERM) 11:43:53.579414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15302): Terminating (SIGTERM) 11:43:53.619437 --- ParallelTerminationStrategy: PID 15296 died... 11:43:53.638822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15296): Terminated: ok {rc=0} 11:43:53.682987 --- ParallelTerminationStrategy: PID 15299 died... 11:43:53.701823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15299): Terminated: ok {rc=0} 11:43:53.745778 --- ParallelTerminationStrategy: PID 15302 died... 11:43:53.764516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15302): Terminated: ok {rc=0} 11:43:53.848474 bus /sierra_3: Setting Powered False 11:43:54.946846 bus /sierra_3: Setting Powered False 11:43:56.064164 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:43:57.213771 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:57.225789 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:43:57.282417 tst mo_mt_call_osmux.py: using LAC 33711 11:43:57.405433 tst mo_mt_call_osmux.py: using RAC 51 11:43:57.529490 tst mo_mt_call_osmux.py: using CellId 33711 11:43:57.651905 tst mo_mt_call_osmux.py: using BVCI 33712 11:43:57.767326 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:57.778690 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:57.789842 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:57.800812 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:57.811941 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:43:57.822908 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:43:57.945076 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:43:58.063637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:58.550755 run create_hlr_db(pid=15305): Launched 11:43:58.679257 bus /sierra_2: Setting Powered False 11:43:59.741452 run create_hlr_db(pid=15305): Terminated: ok {rc=0} 11:44:00.199093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15307): Launched 11:44:00.538453 run osmo-hlr_10.42.42.2(pid=15308): Launched 11:44:00.668372 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:01.270308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15310): Launched 11:44:01.626192 run osmo-stp_10.42.42.5(pid=15311): Launched 11:44:01.819209 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:02.560082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15313): Launched 11:44:02.875692 run osmo-msc_10.42.42.6(pid=15314): Launched 11:44:03.051400 run osmo-stp_10.42.42.5(pid=15311): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15311)] 11:44:03.183738 run osmo-stp_10.42.42.5(pid=15311): stdout: | (launched: 2022-12-13_11:44:01.560165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:03.316291 run osmo-stp_10.42.42.5(pid=15311): stderr: | 20221213114401844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114401844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114401844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114401853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114401855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114401855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114401855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:03.446067 run osmo-stp_10.42.42.5(pid=15311): stdout: | (launched: 2022-12-13_11:44:01.560165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:03.569752 run osmo-stp_10.42.42.5(pid=15311): stderr: | 20221213114401844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114401844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114401844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114401853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114401855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114401855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114401855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:03.717900 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15311): Process ended prematurely: osmo-stp_10.42.42.5(pid=15311) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15311)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:44:03.727106 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:44:03.753768 run osmo-hlr_10.42.42.2(pid=15308): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15308)] 11:44:03.801853 run osmo-hlr_10.42.42.2(pid=15308): stdout: | (launched: 2022-12-13_11:44:00.475786) 11:44:03.851466 run osmo-hlr_10.42.42.2(pid=15308): stderr: | 20221213114400680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114400680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114400680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114400680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114400680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114400680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114400692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114400700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114400701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114400701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:03.920236 run osmo-msc_10.42.42.6(pid=15314): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15314)] 11:44:03.967724 run osmo-msc_10.42.42.6(pid=15314): stdout: | (launched: 2022-12-13_11:44:02.816601) 11:44:04.016824 run osmo-msc_10.42.42.6(pid=15314): stderr: | 20221213114403091 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114403091 DLGLOBAL DEBUG validating counter group 0x7fcbfb006c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114403091 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114403091 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114403091 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114403092 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114403094 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114403095 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114403095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114403095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:04.066447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15307): Terminating (SIGTERM) 11:44:04.106132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15310): Terminating (SIGTERM) 11:44:04.145709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15313): Terminating (SIGTERM) 11:44:04.185783 --- ParallelTerminationStrategy: PID 15307 died... 11:44:04.205298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15307): Terminated: ok {rc=0} 11:44:04.249445 --- ParallelTerminationStrategy: PID 15310 died... 11:44:04.268545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15310): Terminated: ok {rc=0} 11:44:04.312715 --- ParallelTerminationStrategy: PID 15313 died... 11:44:04.331635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15313): Terminated: ok {rc=0} 11:44:04.417531 bus /sierra_3: Setting Powered False 11:44:05.518889 bus /sierra_3: Setting Powered False 11:44:06.636553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:44:07.875946 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:07.883134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:44:07.904752 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:44:07.933725 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:44:07.987464 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:44:08.009432 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:44:08.037521 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:44:08.586970 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:44:08.637463 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:08.648733 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:44:08.705789 tst mo_mt_call.py: using LAC 33712 11:44:08.829274 tst mo_mt_call.py: using RAC 52 11:44:08.951699 tst mo_mt_call.py: using CellId 33712 11:44:09.075636 tst mo_mt_call.py: using BVCI 33713 11:44:09.190403 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:09.201718 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:09.212646 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:09.223555 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:09.234836 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:09.245857 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:44:09.374615 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:44:09.492787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:09.980406 run create_hlr_db(pid=15326): Launched 11:44:10.108582 bus /sierra_2: Setting Powered False 11:44:11.171011 run create_hlr_db(pid=15326): Terminated: ok {rc=0} 11:44:11.608203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15328): Launched 11:44:11.925625 run osmo-hlr_10.42.42.2(pid=15329): Launched 11:44:12.055730 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:12.595392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15331): Launched 11:44:12.910195 run osmo-stp_10.42.42.5(pid=15332): Launched 11:44:13.029147 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:13.594846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15334): Launched 11:44:13.908890 run osmo-msc_10.42.42.6(pid=15335): Launched 11:44:14.084298 run osmo-stp_10.42.42.5(pid=15332): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15332)] 11:44:14.216343 run osmo-stp_10.42.42.5(pid=15332): stdout: | (launched: 2022-12-13_11:44:12.851234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:14.348245 run osmo-stp_10.42.42.5(pid=15332): stderr: | 20221213114413026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114413027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114413027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114413027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114413028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114413028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114413028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:14.478130 run osmo-stp_10.42.42.5(pid=15332): stdout: | (launched: 2022-12-13_11:44:12.851234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:14.601924 run osmo-stp_10.42.42.5(pid=15332): stderr: | 20221213114413026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114413027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114413027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114413027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114413028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114413028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114413028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:14.750538 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15332): Process ended prematurely: osmo-stp_10.42.42.5(pid=15332) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15332)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:44:14.759473 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:44:14.786321 run osmo-hlr_10.42.42.2(pid=15329): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15329)] 11:44:14.835079 run osmo-hlr_10.42.42.2(pid=15329): stdout: | (launched: 2022-12-13_11:44:11.864393) 11:44:14.884584 run osmo-hlr_10.42.42.2(pid=15329): stderr: | 20221213114412061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114412061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114412061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114412061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114412061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114412061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114412076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114412085 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114412085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114412085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:14.953830 run osmo-msc_10.42.42.6(pid=15335): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15335)] 11:44:15.001685 run osmo-msc_10.42.42.6(pid=15335): stdout: | (launched: 2022-12-13_11:44:13.850106) 11:44:15.051106 run osmo-msc_10.42.42.6(pid=15335): stderr: | 20221213114414127 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114414128 DLGLOBAL DEBUG validating counter group 0x7f325542cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114414128 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114414128 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114414128 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114414128 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114414130 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114414130 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114414130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114414130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:15.101641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15328): Terminating (SIGTERM) 11:44:15.141339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15331): Terminating (SIGTERM) 11:44:15.181105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15334): Terminating (SIGTERM) 11:44:15.221243 --- ParallelTerminationStrategy: PID 15328 died... 11:44:15.240441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15328): Terminated: ok {rc=0} 11:44:15.284858 --- ParallelTerminationStrategy: PID 15331 died... 11:44:15.303940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15331): Terminated: ok {rc=0} 11:44:15.348079 --- ParallelTerminationStrategy: PID 15334 died... 11:44:15.366731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15334): Terminated: ok {rc=0} 11:44:15.452439 bus /sierra_3: Setting Powered False 11:44:16.548841 bus /sierra_3: Setting Powered False 11:44:17.664673 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:44:18.816627 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:18.829148 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:44:18.888656 tst mo_mt_call_osmux.py: using LAC 33713 11:44:19.019343 tst mo_mt_call_osmux.py: using RAC 53 11:44:19.149919 tst mo_mt_call_osmux.py: using CellId 33713 11:44:19.281122 tst mo_mt_call_osmux.py: using BVCI 33714 11:44:19.405123 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:19.416670 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:19.428103 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:19.439490 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:19.451282 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:19.463064 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:44:19.585467 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:44:19.708445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:20.195939 run create_hlr_db(pid=15337): Launched 11:44:20.325274 bus /sierra_2: Setting Powered False 11:44:21.387300 run create_hlr_db(pid=15337): Terminated: ok {rc=0} 11:44:21.847268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15339): Launched 11:44:22.186807 run osmo-hlr_10.42.42.2(pid=15340): Launched 11:44:22.316829 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:22.899047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15342): Launched 11:44:23.236366 run osmo-stp_10.42.42.5(pid=15343): Launched 11:44:23.366250 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:23.973589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15345): Launched 11:44:24.313566 run osmo-msc_10.42.42.6(pid=15346): Launched 11:44:24.502297 run osmo-stp_10.42.42.5(pid=15343): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15343)] 11:44:24.644074 run osmo-stp_10.42.42.5(pid=15343): stdout: | (launched: 2022-12-13_11:44:23.173651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:24.786954 run osmo-stp_10.42.42.5(pid=15343): stderr: | 20221213114423372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114423372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114423372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114423373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114423373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114423373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114423373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:24.927640 run osmo-stp_10.42.42.5(pid=15343): stdout: | (launched: 2022-12-13_11:44:23.173651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:25.061291 run osmo-stp_10.42.42.5(pid=15343): stderr: | 20221213114423372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114423372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114423372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114423373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114423373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114423373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114423373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:25.221300 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15343): Process ended prematurely: osmo-stp_10.42.42.5(pid=15343) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15343)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:44:25.230958 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:44:25.258858 run osmo-hlr_10.42.42.2(pid=15340): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15340)] 11:44:25.309822 run osmo-hlr_10.42.42.2(pid=15340): stdout: | (launched: 2022-12-13_11:44:22.123885) 11:44:25.362333 run osmo-hlr_10.42.42.2(pid=15340): stderr: | 20221213114422328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114422328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114422328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114422328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114422328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114422328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114422339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114422348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114422348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114422348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:25.435843 run osmo-msc_10.42.42.6(pid=15346): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15346)] 11:44:25.485903 run osmo-msc_10.42.42.6(pid=15346): stdout: | (launched: 2022-12-13_11:44:24.250567) 11:44:25.537947 run osmo-msc_10.42.42.6(pid=15346): stderr: | 20221213114424577 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114424577 DLGLOBAL DEBUG validating counter group 0x7f3af3a48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114424577 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114424577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114424577 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114424578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114424579 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114424580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114424580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114424580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:25.590405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15339): Terminating (SIGTERM) 11:44:25.632555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15342): Terminating (SIGTERM) 11:44:25.674778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15345): Terminating (SIGTERM) 11:44:25.717773 --- ParallelTerminationStrategy: PID 15339 died... 11:44:25.738315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15339): Terminated: ok {rc=0} 11:44:25.785243 --- ParallelTerminationStrategy: PID 15342 died... 11:44:25.805212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15342): Terminated: ok {rc=0} 11:44:25.851970 --- ParallelTerminationStrategy: PID 15345 died... 11:44:25.871924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15345): Terminated: ok {rc=0} 11:44:25.959954 bus /sierra_3: Setting Powered False 11:44:27.059633 bus /sierra_3: Setting Powered False 11:44:28.176458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:44:29.418453 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:29.425335 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:44:29.447034 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:44:29.476175 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:44:29.529890 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:44:29.551442 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:44:29.579385 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:44:30.128701 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:44:30.184565 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:30.196273 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:44:30.254594 tst mo_mt_call.py: using LAC 33714 11:44:30.388125 tst mo_mt_call.py: using RAC 54 11:44:30.521939 tst mo_mt_call.py: using CellId 33714 11:44:30.645498 tst mo_mt_call.py: using BVCI 33715 11:44:30.770219 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:30.782010 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:30.793984 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:30.805574 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:30.817718 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:30.829655 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:44:30.968382 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:44:31.112523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:31.646531 run create_hlr_db(pid=15351): Launched 11:44:31.810960 bus /sierra_2: Setting Powered False 11:44:32.877594 run create_hlr_db(pid=15351): Terminated: ok {rc=0} 11:44:33.328685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15353): Launched 11:44:33.643764 run osmo-hlr_10.42.42.2(pid=15354): Launched 11:44:33.764740 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:34.305448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15356): Launched 11:44:34.619943 run osmo-stp_10.42.42.5(pid=15357): Launched 11:44:34.740476 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:35.306112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15359): Launched 11:44:35.620875 run osmo-msc_10.42.42.6(pid=15360): Launched 11:44:35.797918 run osmo-stp_10.42.42.5(pid=15357): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15357)] 11:44:35.930204 run osmo-stp_10.42.42.5(pid=15357): stdout: | (launched: 2022-12-13_11:44:34.561072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:36.062033 run osmo-stp_10.42.42.5(pid=15357): stderr: | 20221213114434736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114434736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114434737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114434737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114434738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114434738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114434738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:36.192268 run osmo-stp_10.42.42.5(pid=15357): stdout: | (launched: 2022-12-13_11:44:34.561072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:36.316072 run osmo-stp_10.42.42.5(pid=15357): stderr: | 20221213114434736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114434736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114434737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114434737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114434738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114434738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114434738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:36.464810 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15357): Process ended prematurely: osmo-stp_10.42.42.5(pid=15357) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15357)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:44:36.473902 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:44:36.500648 run osmo-hlr_10.42.42.2(pid=15354): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15354)] 11:44:36.548601 run osmo-hlr_10.42.42.2(pid=15354): stdout: | (launched: 2022-12-13_11:44:33.585448) 11:44:36.598452 run osmo-hlr_10.42.42.2(pid=15354): stderr: | 20221213114433762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114433763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114433763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114433763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114433763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114433763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114433775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114433783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114433783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114433783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:36.667800 run osmo-msc_10.42.42.6(pid=15360): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15360)] 11:44:36.715470 run osmo-msc_10.42.42.6(pid=15360): stdout: | (launched: 2022-12-13_11:44:35.561830) 11:44:36.765126 run osmo-msc_10.42.42.6(pid=15360): stderr: | 20221213114435838 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114435838 DLGLOBAL DEBUG validating counter group 0x7f5ad1e01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114435838 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114435838 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114435838 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114435838 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114435840 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114435840 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114435841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114435841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:36.815050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15353): Terminating (SIGTERM) 11:44:36.854608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15356): Terminating (SIGTERM) 11:44:36.894360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15359): Terminating (SIGTERM) 11:44:36.934315 --- ParallelTerminationStrategy: PID 15353 died... 11:44:36.953605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15353): Terminated: ok {rc=0} 11:44:36.997488 --- ParallelTerminationStrategy: PID 15356 died... 11:44:37.016030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15356): Terminated: ok {rc=0} 11:44:37.060104 --- ParallelTerminationStrategy: PID 15359 died... 11:44:37.078805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15359): Terminated: ok {rc=0} 11:44:37.164741 bus /sierra_3: Setting Powered False 11:44:38.263903 bus /sierra_3: Setting Powered False 11:44:39.378886 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:44:40.530508 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:40.542917 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:44:40.602202 tst mo_mt_call_osmux.py: using LAC 33715 11:44:40.734181 tst mo_mt_call_osmux.py: using RAC 55 11:44:40.871597 tst mo_mt_call_osmux.py: using CellId 33715 11:44:41.005916 tst mo_mt_call_osmux.py: using BVCI 33716 11:44:41.129782 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:41.141509 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:41.152845 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:41.164286 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:41.176044 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:44:41.187795 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:44:41.310415 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:44:41.431249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:41.921113 run create_hlr_db(pid=15362): Launched 11:44:42.048646 bus /sierra_2: Setting Powered False 11:44:43.111329 run create_hlr_db(pid=15362): Terminated: ok {rc=0} 11:44:43.550569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15364): Launched 11:44:43.867579 run osmo-hlr_10.42.42.2(pid=15365): Launched 11:44:43.987305 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:44.525620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15367): Launched 11:44:44.840527 run osmo-stp_10.42.42.5(pid=15368): Launched 11:44:44.960327 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:45.528371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15370): Launched 11:44:45.846877 run osmo-msc_10.42.42.6(pid=15371): Launched 11:44:46.198397 run osmo-stp_10.42.42.5(pid=15368): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15368)] 11:44:46.422481 run osmo-stp_10.42.42.5(pid=15368): stdout: | (launched: 2022-12-13_11:44:44.781219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:46.643472 run osmo-stp_10.42.42.5(pid=15368): stderr: | 20221213114444957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114444957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114444957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114444958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114444958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114444958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114444958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:46.778388 run osmo-stp_10.42.42.5(pid=15368): stdout: | (launched: 2022-12-13_11:44:44.781219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:46.907184 run osmo-stp_10.42.42.5(pid=15368): stderr: | 20221213114444957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114444957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114444957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114444958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114444958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114444958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114444958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:47.060727 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15368): Process ended prematurely: osmo-stp_10.42.42.5(pid=15368) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15368)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:44:47.071254 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:44:47.099531 run osmo-hlr_10.42.42.2(pid=15365): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15365)] 11:44:47.149740 run osmo-hlr_10.42.42.2(pid=15365): stdout: | (launched: 2022-12-13_11:44:43.808355) 11:44:47.201289 run osmo-hlr_10.42.42.2(pid=15365): stderr: | 20221213114443988 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114443988 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114443988 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114443988 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114443988 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114443988 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114444003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114444014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114444014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114444014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:47.272345 run osmo-msc_10.42.42.6(pid=15371): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15371)] 11:44:47.322200 run osmo-msc_10.42.42.6(pid=15371): stdout: | (launched: 2022-12-13_11:44:45.787476) 11:44:47.373593 run osmo-msc_10.42.42.6(pid=15371): stderr: | 20221213114446214 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114446214 DLGLOBAL DEBUG validating counter group 0x7f6396804c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114446214 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114446214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114446214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114446215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114446216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114446228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114446228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114446228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:47.424609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15364): Terminating (SIGTERM) 11:44:47.464660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15367): Terminating (SIGTERM) 11:44:47.504704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15370): Terminating (SIGTERM) 11:44:47.545610 --- ParallelTerminationStrategy: PID 15364 died... 11:44:47.565437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15364): Terminated: ok {rc=0} 11:44:47.610119 --- ParallelTerminationStrategy: PID 15367 died... 11:44:47.628910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15367): Terminated: ok {rc=0} 11:44:47.673656 --- ParallelTerminationStrategy: PID 15370 died... 11:44:47.692708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15370): Terminated: ok {rc=0} 11:44:47.779317 bus /sierra_3: Setting Powered False 11:44:48.881296 bus /sierra_3: Setting Powered False 11:44:49.999624 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:44:51.235788 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:51.242167 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:44:51.263001 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:44:51.290098 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:44:51.343623 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:44:51.365429 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:44:51.393567 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:44:51.941465 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:44:51.991125 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:52.002333 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:44:52.059266 tst mo_mt_call.py: using LAC 33716 11:44:52.184401 tst mo_mt_call.py: using RAC 56 11:44:52.308533 tst mo_mt_call.py: using CellId 33716 11:44:52.433429 tst mo_mt_call.py: using BVCI 33717 11:44:52.546625 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:52.557934 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:52.569291 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:52.580068 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:52.591034 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:44:52.602032 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:44:52.718541 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:44:52.843351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:53.368411 run create_hlr_db(pid=15377): Launched 11:44:53.497699 bus /sierra_2: Setting Powered False 11:44:54.564139 run create_hlr_db(pid=15377): Terminated: ok {rc=0} 11:44:55.033911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15379): Launched 11:44:55.372680 run osmo-hlr_10.42.42.2(pid=15380): Launched 11:44:55.502781 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:56.085407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15382): Launched 11:44:56.425261 run osmo-stp_10.42.42.5(pid=15383): Launched 11:44:56.555816 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:57.165445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15385): Launched 11:44:57.506374 run osmo-msc_10.42.42.6(pid=15386): Launched 11:44:57.695723 run osmo-stp_10.42.42.5(pid=15383): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15383)] 11:44:57.837106 run osmo-stp_10.42.42.5(pid=15383): stdout: | (launched: 2022-12-13_11:44:56.362465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:57.979810 run osmo-stp_10.42.42.5(pid=15383): stderr: | 20221213114456559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114456560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114456560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114456560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114456561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114456561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114456561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:58.120205 run osmo-stp_10.42.42.5(pid=15383): stdout: | (launched: 2022-12-13_11:44:56.362465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:58.253547 run osmo-stp_10.42.42.5(pid=15383): stderr: | 20221213114456559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114456560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114456560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114456560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114456561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114456561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114456561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:58.413686 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15383): Process ended prematurely: osmo-stp_10.42.42.5(pid=15383) [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15383)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:44:58.423452 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:44:58.451522 run osmo-hlr_10.42.42.2(pid=15380): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15380)] 11:44:58.502486 run osmo-hlr_10.42.42.2(pid=15380): stdout: | (launched: 2022-12-13_11:44:55.310009) 11:44:58.555065 run osmo-hlr_10.42.42.2(pid=15380): stderr: | 20221213114455510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114455510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114455510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114455510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114455510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114455511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114455524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114455533 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114455533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114455533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:58.628112 run osmo-msc_10.42.42.6(pid=15386): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15386)] 11:44:58.678635 run osmo-msc_10.42.42.6(pid=15386): stdout: | (launched: 2022-12-13_11:44:57.443200) 11:44:58.730975 run osmo-msc_10.42.42.6(pid=15386): stderr: | 20221213114457770 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114457770 DLGLOBAL DEBUG validating counter group 0x7ffa072fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114457770 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114457770 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114457770 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114457770 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114457772 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114457772 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114457772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114457772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:58.783746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15379): Terminating (SIGTERM) 11:44:58.826392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15382): Terminating (SIGTERM) 11:44:58.868523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15385): Terminating (SIGTERM) 11:44:58.911600 --- ParallelTerminationStrategy: PID 15379 died... 11:44:58.931736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15379): Terminated: ok {rc=0} 11:44:58.978741 --- ParallelTerminationStrategy: PID 15382 died... 11:44:58.998692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15382): Terminated: ok {rc=0} 11:44:59.045505 --- ParallelTerminationStrategy: PID 15385 died... 11:44:59.065584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15385): Terminated: ok {rc=0} 11:44:59.154907 bus /sierra_3: Setting Powered False 11:45:00.253401 bus /sierra_3: Setting Powered False 11:45:01.369287 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:45:02.523194 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:02.535912 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:45:02.596230 tst mo_mt_call_osmux.py: using LAC 33717 11:45:02.729386 tst mo_mt_call_osmux.py: using RAC 57 11:45:02.861291 tst mo_mt_call_osmux.py: using CellId 33717 11:45:02.993175 tst mo_mt_call_osmux.py: using BVCI 33718 11:45:03.107967 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:03.119391 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:03.130590 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:03.141872 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:03.153295 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:03.164627 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:45:03.281725 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:45:03.405100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:03.928511 run create_hlr_db(pid=15391): Launched 11:45:04.058890 bus /sierra_2: Setting Powered False 11:45:05.121607 run create_hlr_db(pid=15391): Terminated: ok {rc=0} 11:45:05.591505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15393): Launched 11:45:05.931913 run osmo-hlr_10.42.42.2(pid=15394): Launched 11:45:06.062017 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:06.643905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15396): Launched 11:45:06.981456 run osmo-stp_10.42.42.5(pid=15397): Launched 11:45:07.111547 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:07.726136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15399): Launched 11:45:08.065071 run osmo-msc_10.42.42.6(pid=15400): Launched 11:45:08.253530 run osmo-stp_10.42.42.5(pid=15397): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15397)] 11:45:08.394150 run osmo-stp_10.42.42.5(pid=15397): stdout: | (launched: 2022-12-13_11:45:06.918631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:08.535497 run osmo-stp_10.42.42.5(pid=15397): stderr: | 20221213114507113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114507113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114507114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114507114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114507115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114507115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114507115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:08.674892 run osmo-stp_10.42.42.5(pid=15397): stdout: | (launched: 2022-12-13_11:45:06.918631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:08.807965 run osmo-stp_10.42.42.5(pid=15397): stderr: | 20221213114507113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114507113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114507114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114507114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114507115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114507115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114507115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:08.967092 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15397): Process ended prematurely: osmo-stp_10.42.42.5(pid=15397) [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15397)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:45:08.976864 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:45:09.004860 run osmo-hlr_10.42.42.2(pid=15394): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15394)] 11:45:09.055701 run osmo-hlr_10.42.42.2(pid=15394): stdout: | (launched: 2022-12-13_11:45:05.869453) 11:45:09.108129 run osmo-hlr_10.42.42.2(pid=15394): stderr: | 20221213114506072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114506072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114506072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114506072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114506072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114506072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114506085 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114506094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114506094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114506094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:09.181811 run osmo-msc_10.42.42.6(pid=15400): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15400)] 11:45:09.231837 run osmo-msc_10.42.42.6(pid=15400): stdout: | (launched: 2022-12-13_11:45:08.002388) 11:45:09.284077 run osmo-msc_10.42.42.6(pid=15400): stderr: | 20221213114508326 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114508326 DLGLOBAL DEBUG validating counter group 0x7f7112991c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114508326 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114508326 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114508326 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114508327 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114508328 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114508329 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114508329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114508329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:09.338557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15393): Terminating (SIGTERM) 11:45:09.380569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15396): Terminating (SIGTERM) 11:45:09.422796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15399): Terminating (SIGTERM) 11:45:09.465940 --- ParallelTerminationStrategy: PID 15393 died... 11:45:09.486497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15393): Terminated: ok {rc=0} 11:45:09.533512 --- ParallelTerminationStrategy: PID 15396 died... 11:45:09.553581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15396): Terminated: ok {rc=0} 11:45:09.600387 --- ParallelTerminationStrategy: PID 15399 died... 11:45:09.620500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15399): Terminated: ok {rc=0} 11:45:09.709342 bus /sierra_3: Setting Powered False 11:45:10.808698 bus /sierra_3: Setting Powered False 11:45:11.924382 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:45:13.163895 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:13.171579 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:45:13.192597 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:45:13.219759 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:45:13.275158 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:45:13.296350 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:45:13.323211 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:45:13.871097 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:45:13.921726 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:13.933329 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:45:13.993192 tst mo_mt_call.py: using LAC 33718 11:45:14.116473 tst mo_mt_call.py: using RAC 58 11:45:14.238524 tst mo_mt_call.py: using CellId 33718 11:45:14.365747 tst mo_mt_call.py: using BVCI 33719 11:45:14.480317 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:14.491655 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:14.502731 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:14.513853 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:14.524874 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:14.535959 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:45:14.659369 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:45:14.788711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:15.311758 run create_hlr_db(pid=15405): Launched 11:45:15.440834 bus /sierra_2: Setting Powered False 11:45:16.505857 run create_hlr_db(pid=15405): Terminated: ok {rc=0} 11:45:16.981978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15407): Launched 11:45:17.333836 run osmo-hlr_10.42.42.2(pid=15408): Launched 11:45:17.464899 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:18.053444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15410): Launched 11:45:18.395220 run osmo-stp_10.42.42.5(pid=15411): Launched 11:45:18.524656 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:19.133707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15413): Launched 11:45:19.475011 run osmo-msc_10.42.42.6(pid=15414): Launched 11:45:19.662167 run osmo-stp_10.42.42.5(pid=15411): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15411)] 11:45:19.804097 run osmo-stp_10.42.42.5(pid=15411): stdout: | (launched: 2022-12-13_11:45:18.331969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:19.947250 run osmo-stp_10.42.42.5(pid=15411): stderr: | 20221213114518528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114518528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114518528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114518529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114518529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114518530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114518530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:20.088445 run osmo-stp_10.42.42.5(pid=15411): stdout: | (launched: 2022-12-13_11:45:18.331969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:20.222279 run osmo-stp_10.42.42.5(pid=15411): stderr: | 20221213114518528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114518528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114518528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114518529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114518529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114518530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114518530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:20.382515 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15411): Process ended prematurely: osmo-stp_10.42.42.5(pid=15411) [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15411)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:45:20.392288 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:45:20.420500 run osmo-hlr_10.42.42.2(pid=15408): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15408)] 11:45:20.472056 run osmo-hlr_10.42.42.2(pid=15408): stdout: | (launched: 2022-12-13_11:45:17.270783) 11:45:20.525325 run osmo-hlr_10.42.42.2(pid=15408): stderr: | 20221213114517472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114517472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114517472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114517472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114517472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114517472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114517485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114517494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114517494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114517494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:20.598524 run osmo-msc_10.42.42.6(pid=15414): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15414)] 11:45:20.649475 run osmo-msc_10.42.42.6(pid=15414): stdout: | (launched: 2022-12-13_11:45:19.411665) 11:45:20.702157 run osmo-msc_10.42.42.6(pid=15414): stderr: | 20221213114519741 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114519741 DLGLOBAL DEBUG validating counter group 0x7fd8fed2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114519741 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114519741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114519742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114519742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114519743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114519744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114519744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114519744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:20.755237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15407): Terminating (SIGTERM) 11:45:20.798056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15410): Terminating (SIGTERM) 11:45:20.841048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15413): Terminating (SIGTERM) 11:45:20.884508 --- ParallelTerminationStrategy: PID 15407 died... 11:45:20.905239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15407): Terminated: ok {rc=0} 11:45:20.952305 --- ParallelTerminationStrategy: PID 15410 died... 11:45:20.972568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15410): Terminated: ok {rc=0} 11:45:21.019617 --- ParallelTerminationStrategy: PID 15413 died... 11:45:21.039827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15413): Terminated: ok {rc=0} 11:45:21.129481 bus /sierra_3: Setting Powered False 11:45:22.229397 bus /sierra_3: Setting Powered False 11:45:23.346345 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:45:24.499559 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:24.511902 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:45:24.569943 tst mo_mt_call_osmux.py: using LAC 33719 11:45:24.704364 tst mo_mt_call_osmux.py: using RAC 59 11:45:24.837599 tst mo_mt_call_osmux.py: using CellId 33719 11:45:24.970676 tst mo_mt_call_osmux.py: using BVCI 33720 11:45:25.093279 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:25.104816 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:25.116228 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:25.127627 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:25.139362 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:25.151195 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:45:25.271136 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:45:25.392649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:25.915616 run create_hlr_db(pid=15416): Launched 11:45:26.045382 bus /sierra_2: Setting Powered False 11:45:27.111732 run create_hlr_db(pid=15416): Terminated: ok {rc=0} 11:45:27.579045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15418): Launched 11:45:27.918786 run osmo-hlr_10.42.42.2(pid=15419): Launched 11:45:28.047018 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:28.629356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15421): Launched 11:45:28.970260 run osmo-stp_10.42.42.5(pid=15422): Launched 11:45:29.101225 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:29.710261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15424): Launched 11:45:30.048699 run osmo-msc_10.42.42.6(pid=15425): Launched 11:45:30.237225 run osmo-stp_10.42.42.5(pid=15422): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15422)] 11:45:30.378538 run osmo-stp_10.42.42.5(pid=15422): stdout: | (launched: 2022-12-13_11:45:28.906964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:30.520475 run osmo-stp_10.42.42.5(pid=15422): stderr: | 20221213114529103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114529103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114529103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114529104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114529104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114529104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114529104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:30.660453 run osmo-stp_10.42.42.5(pid=15422): stdout: | (launched: 2022-12-13_11:45:28.906964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:30.793861 run osmo-stp_10.42.42.5(pid=15422): stderr: | 20221213114529103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114529103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114529103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114529104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114529104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114529104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114529104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:30.956633 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15422): Process ended prematurely: osmo-stp_10.42.42.5(pid=15422) [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15422)] [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:45:30.967646 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:45:30.996826 run osmo-hlr_10.42.42.2(pid=15419): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15419)] 11:45:31.050771 run osmo-hlr_10.42.42.2(pid=15419): stdout: | (launched: 2022-12-13_11:45:27.855441) 11:45:31.105736 run osmo-hlr_10.42.42.2(pid=15419): stderr: | 20221213114528057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114528057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114528057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114528057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114528057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114528058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114528069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114528078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114528078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114528078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:31.181456 run osmo-msc_10.42.42.6(pid=15425): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15425)] 11:45:31.233502 run osmo-msc_10.42.42.6(pid=15425): stdout: | (launched: 2022-12-13_11:45:29.985978) 11:45:31.289429 run osmo-msc_10.42.42.6(pid=15425): stderr: | 20221213114530312 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114530313 DLGLOBAL DEBUG validating counter group 0x7f02239c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114530313 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114530313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114530313 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114530313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114530315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114530315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114530315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114530315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:31.344721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15418): Terminating (SIGTERM) 11:45:31.389147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15421): Terminating (SIGTERM) 11:45:31.435090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15424): Terminating (SIGTERM) 11:45:31.480156 --- ParallelTerminationStrategy: PID 15418 died... 11:45:31.502484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15418): Terminated: ok {rc=0} 11:45:31.551762 --- ParallelTerminationStrategy: PID 15421 died... 11:45:31.573746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15421): Terminated: ok {rc=0} 11:45:31.623333 --- ParallelTerminationStrategy: PID 15424 died... 11:45:31.645351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15424): Terminated: ok {rc=0} 11:45:31.743657 bus /sierra_3: Setting Powered False 11:45:32.852673 bus /sierra_3: Setting Powered False 11:45:33.972680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:45:35.216887 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:35.223262 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:45:35.244201 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:45:35.271417 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:45:35.323364 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:45:35.344408 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:45:35.371681 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:45:35.925829 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:45:35.981655 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:35.993586 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:45:36.052492 tst mo_mt_call.py: using LAC 33720 11:45:36.185390 tst mo_mt_call.py: using RAC 60 11:45:36.317729 tst mo_mt_call.py: using CellId 33720 11:45:36.449638 tst mo_mt_call.py: using BVCI 33721 11:45:36.573511 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:36.585147 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:36.596513 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:36.607929 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:36.619605 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:36.631344 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:36.749970 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:36.872552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:37.395662 run create_hlr_db(pid=15430): Launched 11:45:37.524823 bus /sierra_2: Setting Powered False 11:45:38.590320 run create_hlr_db(pid=15430): Terminated: ok {rc=0} 11:45:39.040364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15432): Launched 11:45:39.358171 run osmo-hlr_10.42.42.2(pid=15433): Launched 11:45:39.478862 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:40.022746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15435): Launched 11:45:40.338079 run osmo-stp_10.42.42.5(pid=15436): Launched 11:45:40.456253 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:41.023668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15438): Launched 11:45:41.340127 run osmo-msc_10.42.42.6(pid=15439): Launched 11:45:41.516800 run osmo-stp_10.42.42.5(pid=15436): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15436)] 11:45:41.650052 run osmo-stp_10.42.42.5(pid=15436): stdout: | (launched: 2022-12-13_11:45:40.278892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:41.781830 run osmo-stp_10.42.42.5(pid=15436): stderr: | 20221213114540454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114540455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114540455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114540455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114540456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114540456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114540456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:41.911695 run osmo-stp_10.42.42.5(pid=15436): stdout: | (launched: 2022-12-13_11:45:40.278892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:42.036667 run osmo-stp_10.42.42.5(pid=15436): stderr: | 20221213114540454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114540455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114540455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114540455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114540456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114540456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114540456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:42.185316 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15436): Process ended prematurely: osmo-stp_10.42.42.5(pid=15436) [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15436)] [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:45:42.194344 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:45:42.221075 run osmo-hlr_10.42.42.2(pid=15433): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15433)] 11:45:42.269625 run osmo-hlr_10.42.42.2(pid=15433): stdout: | (launched: 2022-12-13_11:45:39.299079) 11:45:42.319600 run osmo-hlr_10.42.42.2(pid=15433): stderr: | 20221213114539480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114539481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114539481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114539481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114539481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114539481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114539493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114539501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114539502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114539502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:42.389208 run osmo-msc_10.42.42.6(pid=15439): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15439)] 11:45:42.437218 run osmo-msc_10.42.42.6(pid=15439): stdout: | (launched: 2022-12-13_11:45:41.280868) 11:45:42.486988 run osmo-msc_10.42.42.6(pid=15439): stderr: | 20221213114541555 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114541555 DLGLOBAL DEBUG validating counter group 0x7efd2d3e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114541555 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114541555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114541555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114541556 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114541558 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114541558 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114541558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114541558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:42.537469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15432): Terminating (SIGTERM) 11:45:42.577526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15435): Terminating (SIGTERM) 11:45:42.617707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15438): Terminating (SIGTERM) 11:45:42.658227 --- ParallelTerminationStrategy: PID 15432 died... 11:45:42.677704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15432): Terminated: ok {rc=0} 11:45:42.722148 --- ParallelTerminationStrategy: PID 15435 died... 11:45:42.740862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15435): Terminated: ok {rc=0} 11:45:42.785611 --- ParallelTerminationStrategy: PID 15438 died... 11:45:42.804475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15438): Terminated: ok {rc=0} 11:45:42.891880 bus /sierra_3: Setting Powered False 11:45:43.992656 bus /sierra_3: Setting Powered False 11:45:45.107319 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:45:46.260592 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:46.274470 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:45:46.337673 tst mo_mt_call_osmux.py: using LAC 33721 11:45:46.463473 tst mo_mt_call_osmux.py: using RAC 61 11:45:46.599186 tst mo_mt_call_osmux.py: using CellId 33721 11:45:46.724690 tst mo_mt_call_osmux.py: using BVCI 33722 11:45:46.852131 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:46.865182 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:46.877937 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:46.891396 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:46.905525 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:45:46.918978 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:47.058423 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:47.201949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:47.730465 run create_hlr_db(pid=15441): Launched 11:45:47.858678 bus /sierra_2: Setting Powered False 11:45:48.925257 run create_hlr_db(pid=15441): Terminated: ok {rc=0} 11:45:49.376020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15443): Launched 11:45:49.692686 run osmo-hlr_10.42.42.2(pid=15444): Launched 11:45:49.812368 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:50.372460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15446): Launched 11:45:50.689519 run osmo-stp_10.42.42.5(pid=15447): Launched 11:45:50.809150 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:51.378571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15449): Launched 11:45:51.695858 run osmo-msc_10.42.42.6(pid=15450): Launched 11:45:51.878037 run osmo-stp_10.42.42.5(pid=15447): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15447)] 11:45:52.017125 run osmo-stp_10.42.42.5(pid=15447): stdout: | (launched: 2022-12-13_11:45:50.630273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:52.160821 run osmo-stp_10.42.42.5(pid=15447): stderr: | 20221213114550804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114550804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114550804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114550805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114550807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114550807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114550807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:52.300531 run osmo-stp_10.42.42.5(pid=15447): stdout: | (launched: 2022-12-13_11:45:50.630273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:52.434649 run osmo-stp_10.42.42.5(pid=15447): stderr: | 20221213114550804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114550804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114550804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114550805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114550807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114550807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114550807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:52.594746 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15447): Process ended prematurely: osmo-stp_10.42.42.5(pid=15447) [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15447)] [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:45:52.604658 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:45:52.632726 run osmo-hlr_10.42.42.2(pid=15444): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15444)] 11:45:52.683841 run osmo-hlr_10.42.42.2(pid=15444): stdout: | (launched: 2022-12-13_11:45:49.633562) 11:45:52.736362 run osmo-hlr_10.42.42.2(pid=15444): stderr: | 20221213114549815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114549815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114549815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114549815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114549815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114549816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114549827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114549839 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114549839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114549839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:52.810120 run osmo-msc_10.42.42.6(pid=15450): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15450)] 11:45:52.860845 run osmo-msc_10.42.42.6(pid=15450): stdout: | (launched: 2022-12-13_11:45:51.636209) 11:45:52.913466 run osmo-msc_10.42.42.6(pid=15450): stderr: | 20221213114551922 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114551922 DLGLOBAL DEBUG validating counter group 0x7f0093ad2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114551922 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114551922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114551922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114551923 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114551925 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114551926 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114551926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114551926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:52.966074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15443): Terminating (SIGTERM) 11:45:53.008609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15446): Terminating (SIGTERM) 11:45:53.050930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15449): Terminating (SIGTERM) 11:45:53.093778 --- ParallelTerminationStrategy: PID 15443 died... 11:45:53.114817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15443): Terminated: ok {rc=0} 11:45:53.162015 --- ParallelTerminationStrategy: PID 15446 died... 11:45:53.182423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15446): Terminated: ok {rc=0} 11:45:53.229352 --- ParallelTerminationStrategy: PID 15449 died... 11:45:53.249539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15449): Terminated: ok {rc=0} 11:45:53.338763 bus /sierra_3: Setting Powered False 11:45:54.438152 bus /sierra_3: Setting Powered False 11:45:55.555375 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:45:56.793871 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:56.799265 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:45:56.820392 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:45:56.847702 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:45:56.900550 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:45:56.922406 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:45:56.951976 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:45:57.497118 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:45:57.547473 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:57.558671 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:45:57.616548 tst mo_mt_call.py: using LAC 33722 11:45:57.740675 tst mo_mt_call.py: using RAC 62 11:45:57.864912 tst mo_mt_call.py: using CellId 33722 11:45:57.989448 tst mo_mt_call.py: using BVCI 33723 11:45:58.105301 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:58.116428 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:58.127237 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:58.138018 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:58.148732 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:45:58.160168 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:45:58.282032 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:45:58.403939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:58.926347 run create_hlr_db(pid=15457): Launched 11:45:59.056112 bus /sierra_2: Setting Powered False 11:46:00.122800 run create_hlr_db(pid=15457): Terminated: ok {rc=0} 11:46:00.572021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15459): Launched 11:46:00.897010 run osmo-hlr_10.42.42.2(pid=15460): Launched 11:46:01.145846 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:01.791895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15462): Launched 11:46:02.149949 run osmo-stp_10.42.42.5(pid=15463): Launched 11:46:02.405268 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:02.971957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15465): Launched 11:46:03.288452 run osmo-msc_10.42.42.6(pid=15466): Launched 11:46:03.464355 run osmo-stp_10.42.42.5(pid=15463): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15463)] 11:46:03.596499 run osmo-stp_10.42.42.5(pid=15463): stdout: | (launched: 2022-12-13_11:46:02.085792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:03.727803 run osmo-stp_10.42.42.5(pid=15463): stderr: | 20221213114602296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114602296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114602296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114602296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114602297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114602297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114602297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:03.857688 run osmo-stp_10.42.42.5(pid=15463): stdout: | (launched: 2022-12-13_11:46:02.085792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:03.981516 run osmo-stp_10.42.42.5(pid=15463): stderr: | 20221213114602296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114602296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114602296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114602296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114602297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114602297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114602297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:04.129716 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15463): Process ended prematurely: osmo-stp_10.42.42.5(pid=15463) [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15463)] [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:46:04.139153 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 11:46:04.166201 run osmo-hlr_10.42.42.2(pid=15460): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15460)] 11:46:04.214517 run osmo-hlr_10.42.42.2(pid=15460): stdout: | (launched: 2022-12-13_11:46:00.829919) 11:46:04.264750 run osmo-hlr_10.42.42.2(pid=15460): stderr: | 20221213114601109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114601109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114601109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114601109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114601109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114601109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114601125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114601144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114601144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114601146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:04.334798 run osmo-msc_10.42.42.6(pid=15466): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15466)] 11:46:04.383362 run osmo-msc_10.42.42.6(pid=15466): stdout: | (launched: 2022-12-13_11:46:03.229223) 11:46:04.433854 run osmo-msc_10.42.42.6(pid=15466): stderr: | 20221213114603506 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114603506 DLGLOBAL DEBUG validating counter group 0x7f24bccb7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114603506 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114603506 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114603506 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114603506 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114603508 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114603508 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114603509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114603509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:04.484066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15459): Terminating (SIGTERM) 11:46:04.524288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15462): Terminating (SIGTERM) 11:46:04.564385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15465): Terminating (SIGTERM) 11:46:04.604839 --- ParallelTerminationStrategy: PID 15459 died... 11:46:04.624471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15459): Terminated: ok {rc=0} 11:46:04.669390 --- ParallelTerminationStrategy: PID 15462 died... 11:46:04.688482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15462): Terminated: ok {rc=0} 11:46:04.732867 --- ParallelTerminationStrategy: PID 15465 died... 11:46:04.752245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15465): Terminated: ok {rc=0} 11:46:04.840153 bus /sierra_3: Setting Powered False 11:46:05.942545 bus /sierra_3: Setting Powered False 11:46:07.058685 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:46:08.209875 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:08.221662 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:46:08.281105 tst mo_mt_call_osmux.py: using LAC 33723 11:46:08.404518 tst mo_mt_call_osmux.py: using RAC 63 11:46:08.528110 tst mo_mt_call_osmux.py: using CellId 33723 11:46:08.652494 tst mo_mt_call_osmux.py: using BVCI 33724 11:46:08.767114 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:08.778297 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:08.789135 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:08.799858 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:08.810701 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:08.822072 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:46:08.938903 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:46:09.055895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:09.543463 run create_hlr_db(pid=15468): Launched 11:46:09.673308 bus /sierra_2: Setting Powered False 11:46:10.739842 run create_hlr_db(pid=15468): Terminated: ok {rc=0} 11:46:11.209223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15470): Launched 11:46:11.547521 run osmo-hlr_10.42.42.2(pid=15471): Launched 11:46:11.678166 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:12.259723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15473): Launched 11:46:12.599227 run osmo-stp_10.42.42.5(pid=15474): Launched 11:46:12.727721 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:13.343238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15476): Launched 11:46:13.682559 run osmo-msc_10.42.42.6(pid=15477): Launched 11:46:13.873218 run osmo-stp_10.42.42.5(pid=15474): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15474)] 11:46:14.015248 run osmo-stp_10.42.42.5(pid=15474): stdout: | (launched: 2022-12-13_11:46:12.536015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:14.157713 run osmo-stp_10.42.42.5(pid=15474): stderr: | 20221213114612731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114612731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114612732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114612732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114612734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114612735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114612735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:14.297732 run osmo-stp_10.42.42.5(pid=15474): stdout: | (launched: 2022-12-13_11:46:12.536015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:14.431392 run osmo-stp_10.42.42.5(pid=15474): stderr: | 20221213114612731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114612731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114612732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114612732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114612734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114612735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114612735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:14.591513 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15474): Process ended prematurely: osmo-stp_10.42.42.5(pid=15474) [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15474)] [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:46:14.601426 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:46:14.629683 run osmo-hlr_10.42.42.2(pid=15471): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15471)] 11:46:14.681139 run osmo-hlr_10.42.42.2(pid=15471): stdout: | (launched: 2022-12-13_11:46:11.484384) 11:46:14.733973 run osmo-hlr_10.42.42.2(pid=15471): stderr: | 20221213114611687 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114611687 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114611688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114611688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114611688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114611688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114611699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114611708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114611708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114611708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:14.807856 run osmo-msc_10.42.42.6(pid=15477): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15477)] 11:46:14.858958 run osmo-msc_10.42.42.6(pid=15477): stdout: | (launched: 2022-12-13_11:46:13.619272) 11:46:14.911676 run osmo-msc_10.42.42.6(pid=15477): stderr: | 20221213114613946 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114613946 DLGLOBAL DEBUG validating counter group 0x7f80458f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114613946 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114613946 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114613946 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114613946 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114613948 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114613948 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114613949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114613949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:14.964593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15470): Terminating (SIGTERM) 11:46:15.007022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15473): Terminating (SIGTERM) 11:46:15.049412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15476): Terminating (SIGTERM) 11:46:15.092590 --- ParallelTerminationStrategy: PID 15470 died... 11:46:15.113346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15470): Terminated: ok {rc=0} 11:46:15.160212 --- ParallelTerminationStrategy: PID 15473 died... 11:46:15.180410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15473): Terminated: ok {rc=0} 11:46:15.227517 --- ParallelTerminationStrategy: PID 15476 died... 11:46:15.247673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15476): Terminated: ok {rc=0} 11:46:15.336210 bus /sierra_3: Setting Powered False 11:46:16.437737 bus /sierra_3: Setting Powered False 11:46:17.553049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 emergency:oc2g --------------------------------------------------------------------- 11:46:18.794421 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:46:18.799136 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 11:46:18.820523 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 11:46:18.849877 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 11:46:18.939339 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 11:46:18.960277 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 11:46:18.987160 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 11:46:19.573082 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2389 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 11:46:19.578270 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:19.589857 tst emergency:oc2g: Using 1 x bts (candidates: 1) 11:46:19.626776 tst emergency_mo_mt_call.py: using LAC 33724 11:46:19.757326 tst emergency_mo_mt_call.py: using RAC 64 11:46:19.889193 tst emergency_mo_mt_call.py: using CellId 33724 11:46:20.010874 tst emergency_mo_mt_call.py: using BVCI 33725 11:46:20.124797 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:20.135689 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:20.146610 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:20.157263 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:20.167618 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:20.178045 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:46:20.298092 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:46:20.415655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:20.897972 run create_hlr_db(pid=15482): Launched 11:46:21.026387 bus /sierra_2: Setting Powered False 11:46:22.086213 run create_hlr_db(pid=15482): Terminated: ok {rc=0} 11:46:22.541405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15484): Launched 11:46:22.877604 run osmo-hlr_10.42.42.2(pid=15485): Launched 11:46:23.005998 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:23.579198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15487): Launched 11:46:23.912753 run osmo-stp_10.42.42.5(pid=15488): Launched 11:46:24.053353 tst emergency_mo_mt_call.py: using MSISDN 8142 11:46:24.225129 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:24.821123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15490): Launched 11:46:25.155413 run osmo-msc_10.42.42.6(pid=15491): Launched 11:46:25.341328 run osmo-stp_10.42.42.5(pid=15488): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15488)] 11:46:25.480500 run osmo-stp_10.42.42.5(pid=15488): stdout: | (launched: 2022-12-13_11:46:23.850275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:25.620396 run osmo-stp_10.42.42.5(pid=15488): stderr: | 20221213114624048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114624048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114624048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114624049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114624049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114624049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114624049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:25.758536 run osmo-stp_10.42.42.5(pid=15488): stdout: | (launched: 2022-12-13_11:46:23.850275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:25.890496 run osmo-stp_10.42.42.5(pid=15488): stderr: | 20221213114624048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114624048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114624048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114624049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114624049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114624049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114624049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:26.047999 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15488): Process ended prematurely: osmo-stp_10.42.42.5(pid=15488) [trial-2389↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15488)] [trial-2389↪emergency:oc2g↪emergency_mo_mt_call.py:19] 11:46:26.057071 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 11:46:26.084734 run osmo-hlr_10.42.42.2(pid=15485): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15485)] 11:46:26.136030 run osmo-hlr_10.42.42.2(pid=15485): stdout: | (launched: 2022-12-13_11:46:22.815005) 11:46:26.188843 run osmo-hlr_10.42.42.2(pid=15485): stderr: | 20221213114623019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114623019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114623019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114623019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114623019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114623019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114623032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114623040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114623040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114623040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:26.262346 run osmo-msc_10.42.42.6(pid=15491): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15491)] 11:46:26.313239 run osmo-msc_10.42.42.6(pid=15491): stdout: | (launched: 2022-12-13_11:46:25.093442) 11:46:26.366037 run osmo-msc_10.42.42.6(pid=15491): stderr: | 20221213114625416 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114625416 DLGLOBAL DEBUG validating counter group 0x7fdc6b90bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114625417 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114625417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114625417 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114625417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114625419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114625419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114625419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114625419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:26.419112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15484): Terminating (SIGTERM) 11:46:26.461638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15487): Terminating (SIGTERM) 11:46:26.504676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15490): Terminating (SIGTERM) 11:46:26.548075 --- ParallelTerminationStrategy: PID 15484 died... 11:46:26.568870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15484): Terminated: ok {rc=0} 11:46:26.616311 --- ParallelTerminationStrategy: PID 15487 died... 11:46:26.636746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15487): Terminated: ok {rc=0} 11:46:26.684074 --- ParallelTerminationStrategy: PID 15490 died... 11:46:26.704447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15490): Terminated: ok {rc=0} 11:46:26.794610 bus /sierra_3: Setting Powered False 11:46:27.893388 bus /sierra_3: Setting Powered False 11:46:29.011008 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 11:46:30.099342 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:30.111361 tst emergency:oc2g: Using 1 x bts (candidates: 1) 11:46:30.152190 tst emergency_preemptive_call.py: using LAC 33725 11:46:30.283195 tst emergency_preemptive_call.py: using RAC 65 11:46:30.413172 tst emergency_preemptive_call.py: using CellId 33725 11:46:30.547715 tst emergency_preemptive_call.py: using BVCI 33726 11:46:30.671861 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:30.683131 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:30.694284 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:30.705447 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:30.717366 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:46:30.729207 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:46:30.849479 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:46:30.982240 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:46:31.110887 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:46:31.233663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:31.781617 run create_hlr_db(pid=15493): Launched 11:46:31.955203 bus /sierra_2: Setting Powered False 11:46:33.021066 run create_hlr_db(pid=15493): Terminated: ok {rc=0} 11:46:33.467045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15495): Launched 11:46:33.780311 run osmo-hlr_10.42.42.2(pid=15496): Launched 11:46:33.899623 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:34.432301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15498): Launched 11:46:34.744106 run osmo-stp_10.42.42.5(pid=15499): Launched 11:46:34.872513 tst emergency_preemptive_call.py: using MSISDN 8143 11:46:35.028085 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:35.581145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15501): Launched 11:46:35.891733 run osmo-msc_10.42.42.6(pid=15502): Launched 11:46:36.064616 run osmo-stp_10.42.42.5(pid=15499): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15499)] 11:46:36.194521 run osmo-stp_10.42.42.5(pid=15499): stdout: | (launched: 2022-12-13_11:46:34.685889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:36.325894 run osmo-stp_10.42.42.5(pid=15499): stderr: | 20221213114634857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114634857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114634858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114634858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114634860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114634860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114634861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:36.454808 run osmo-stp_10.42.42.5(pid=15499): stdout: | (launched: 2022-12-13_11:46:34.685889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:36.577199 run osmo-stp_10.42.42.5(pid=15499): stderr: | 20221213114634857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114634857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114634858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114634858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114634860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114634860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114634861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:36.723601 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15499): Process ended prematurely: osmo-stp_10.42.42.5(pid=15499) [trial-2389↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15499)] [trial-2389↪emergency:oc2g↪emergency_preemptive_call.py:32] 11:46:36.732140 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 11:46:36.758692 run osmo-hlr_10.42.42.2(pid=15496): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15496)] 11:46:36.807539 run osmo-hlr_10.42.42.2(pid=15496): stdout: | (launched: 2022-12-13_11:46:33.721724) 11:46:36.857482 run osmo-hlr_10.42.42.2(pid=15496): stderr: | 20221213114633900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114633900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114633900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114633900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114633900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114633900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114633913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114633924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114633924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114633924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:36.927348 run osmo-msc_10.42.42.6(pid=15502): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15502)] 11:46:36.975346 run osmo-msc_10.42.42.6(pid=15502): stdout: | (launched: 2022-12-13_11:46:35.832829) 11:46:37.024785 run osmo-msc_10.42.42.6(pid=15502): stderr: | 20221213114636110 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213114636110 DLGLOBAL DEBUG validating counter group 0x7efc99a21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213114636110 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213114636110 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213114636110 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213114636111 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213114636112 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213114636113 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213114636113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213114636113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:37.074869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15495): Terminating (SIGTERM) 11:46:37.114793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15498): Terminating (SIGTERM) 11:46:37.154652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15501): Terminating (SIGTERM) 11:46:37.194983 --- ParallelTerminationStrategy: PID 15495 died... 11:46:37.214573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15495): Terminated: ok {rc=0} 11:46:37.259039 --- ParallelTerminationStrategy: PID 15498 died... 11:46:37.278036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15498): Terminated: ok {rc=0} 11:46:37.322443 --- ParallelTerminationStrategy: PID 15501 died... 11:46:37.341705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15501): Terminated: ok {rc=0} 11:46:37.428886 bus /sierra_9: Setting Powered False 11:46:38.531508 bus /sierra_9: Setting Powered False 11:46:39.650890 bus /sierra_8: Setting Powered False 11:46:40.750199 bus /sierra_8: Setting Powered False 11:46:41.866900 bus /sierra_3: Setting Powered False 11:46:42.968080 bus /sierra_3: Setting Powered False 11:46:44.083421 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:oc2g --------------------------------------------------------------------- 11:46:45.345720 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:46:45.349882 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 11:46:45.370598 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 11:46:45.409376 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 11:46:45.499025 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 11:46:45.522071 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 11:46:45.562953 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 11:46:46.149367 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 11:46:46.217109 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:46.231929 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:46:46.275511 tst cs_paging_gprs_active.py: using LAC 33726 11:46:46.406187 tst cs_paging_gprs_active.py: using RAC 66 11:46:46.536224 tst cs_paging_gprs_active.py: using CellId 33726 11:46:46.675112 tst cs_paging_gprs_active.py: using BVCI 33727 11:46:46.802571 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:46.814607 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:46.826480 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:46.838347 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:46.851269 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:46.864859 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:46.878244 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:46.891108 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:46.904376 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:46:47.037563 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:46:47.164714 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:46:47.395164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:46:47.736558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15507): Launched 11:46:48.033252 run iperf3-srv_10.42.42.10(pid=15508): Launched 11:46:48.162186 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:46:48.390280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:46:48.730671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15509): Launched 11:46:49.028390 run iperf3-srv_10.42.42.10(pid=15510): Launched 11:46:49.155159 tst cs_paging_gprs_active.py:38: start network... 11:46:49.382748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:49.904812 run create_hlr_db(pid=15511): Launched 11:46:50.034179 bus /sierra_2: Setting Powered False 11:46:51.100738 run create_hlr_db(pid=15511): Terminated: ok {rc=0} 11:46:51.570131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15513): Launched 11:46:51.910367 run osmo-hlr_10.42.42.2(pid=15514): Launched 11:46:52.041098 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:52.624531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15516): Launched 11:46:52.963046 run osmo-stp_10.42.42.5(pid=15517): Launched 11:46:53.091616 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:46:53.673308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15519): Launched 11:46:53.803408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:46:54.090815 run patchelf(pid=15520): Launched 11:46:54.279288 run osmo-stp_10.42.42.5(pid=15517): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15517)] 11:46:54.421214 run osmo-stp_10.42.42.5(pid=15517): stdout: | (launched: 2022-12-13_11:46:52.899717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:54.565627 run osmo-stp_10.42.42.5(pid=15517): stderr: | 20221213114653096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114653096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114653096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114653097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114653097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114653097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114653097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:54.710202 run osmo-stp_10.42.42.5(pid=15517): stdout: | (launched: 2022-12-13_11:46:52.899717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:54.847379 run osmo-stp_10.42.42.5(pid=15517): stderr: | 20221213114653096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114653096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114653096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114653097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114653097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114653097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114653097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:55.011247 run patchelf(pid=15520): Terminating (SIGINT) 11:46:55.199975 run patchelf(pid=15520): Terminated: ok {rc=0} 11:46:55.335688 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15517): Process ended prematurely: osmo-stp_10.42.42.5(pid=15517) [trial-2389↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15517)] [trial-2389↪gprs:oc2g↪cs_paging_gprs_active.py:38] 11:46:55.346012 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 11:46:55.375056 run osmo-hlr_10.42.42.2(pid=15514): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15514)] 11:46:55.426208 run osmo-hlr_10.42.42.2(pid=15514): stdout: | (launched: 2022-12-13_11:46:51.846512) 11:46:55.478702 run osmo-hlr_10.42.42.2(pid=15514): stderr: | 20221213114652053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114652053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114652053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114652053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114652053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114652053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114652066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114652075 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114652075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114652075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:55.531801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15507): Terminating (SIGTERM) 11:46:55.574150 run iperf3-srv_10.42.42.10(pid=15508): Terminating (SIGTERM) 11:46:55.616296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15509): Terminating (SIGTERM) 11:46:55.658516 run iperf3-srv_10.42.42.10(pid=15510): Terminating (SIGTERM) 11:46:55.700658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15513): Terminating (SIGTERM) 11:46:55.743433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15516): Terminating (SIGTERM) 11:46:55.786120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15519): Terminating (SIGTERM) 11:46:55.829140 --- ParallelTerminationStrategy: PID 15507 died... 11:46:55.849758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15507): Terminated: ok {rc=0} 11:46:55.896758 --- ParallelTerminationStrategy: PID 15508 died... 11:46:55.916644 run iperf3-srv_10.42.42.10(pid=15508): Terminated {rc=256} 11:46:55.963298 --- ParallelTerminationStrategy: PID 15509 died... 11:46:55.983282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15509): Terminated: ok {rc=0} 11:46:56.029742 --- ParallelTerminationStrategy: PID 15510 died... 11:46:56.049711 run iperf3-srv_10.42.42.10(pid=15510): Terminated {rc=256} 11:46:56.096146 --- ParallelTerminationStrategy: PID 15513 died... 11:46:56.116170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15513): Terminated: ok {rc=0} 11:46:56.162748 --- ParallelTerminationStrategy: PID 15516 died... 11:46:56.182778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15516): Terminated: ok {rc=0} 11:46:56.229510 --- ParallelTerminationStrategy: PID 15519 died... 11:46:56.249674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15519): Terminated: ok {rc=0} 11:46:56.339127 bus /gobi_0: Setting Powered False 11:46:57.440424 bus /gobi_0: Setting Powered False 11:46:58.559740 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g iperf3.py ---------------------------------------------- 11:46:59.708839 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:46:59.720182 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:46:59.756415 tst iperf3.py: using LAC 33727 11:46:59.889868 tst iperf3.py: using RAC 67 11:47:00.027893 tst iperf3.py: using CellId 33727 11:47:00.158845 tst iperf3.py: using BVCI 33728 11:47:00.281667 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:00.292814 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:00.303998 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:00.314941 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:00.326200 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:00.337392 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:00.348826 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:00.360154 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:00.371860 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:47:00.491901 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:47:00.706621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:01.058590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15521): Launched 11:47:01.370664 run iperf3-srv_10.42.42.10(pid=15522): Launched 11:47:01.500477 tst iperf3.py:8: start network... 11:47:01.737192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:02.273041 run create_hlr_db(pid=15523): Launched 11:47:02.403849 bus /gobi_6: Setting Powered False 11:47:03.469510 run create_hlr_db(pid=15523): Terminated: ok {rc=0} 11:47:03.941128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15525): Launched 11:47:04.280004 run osmo-hlr_10.42.42.2(pid=15526): Launched 11:47:04.408540 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:04.993828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15528): Launched 11:47:05.333968 run osmo-stp_10.42.42.5(pid=15529): Launched 11:47:05.463402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:06.049474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15531): Launched 11:47:06.180421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:06.468248 run patchelf(pid=15532): Launched 11:47:06.655696 run osmo-stp_10.42.42.5(pid=15529): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15529)] 11:47:06.798776 run osmo-stp_10.42.42.5(pid=15529): stdout: | (launched: 2022-12-13_11:47:05.270496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:06.943480 run osmo-stp_10.42.42.5(pid=15529): stderr: | 20221213114705466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114705467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114705467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114705467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114705468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114705468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114705468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:07.088008 run osmo-stp_10.42.42.5(pid=15529): stdout: | (launched: 2022-12-13_11:47:05.270496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:07.225790 run osmo-stp_10.42.42.5(pid=15529): stderr: | 20221213114705466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114705467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114705467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114705467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114705468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114705468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114705468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:07.389338 run patchelf(pid=15532): Terminating (SIGINT) 11:47:07.577682 run patchelf(pid=15532): Terminated: ok {rc=0} 11:47:07.713580 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15529): Process ended prematurely: osmo-stp_10.42.42.5(pid=15529) [trial-2389↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15529)] [trial-2389↪gprs:oc2g↪iperf3.py:8] 11:47:07.724010 tst iperf3.py:8: Test FAILED (8.1 sec) 11:47:07.753052 run osmo-hlr_10.42.42.2(pid=15526): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15526)] 11:47:07.804245 run osmo-hlr_10.42.42.2(pid=15526): stdout: | (launched: 2022-12-13_11:47:04.216847) 11:47:07.857339 run osmo-hlr_10.42.42.2(pid=15526): stderr: | 20221213114704419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114704419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114704419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114704419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114704419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114704419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114704431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114704440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114704440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114704440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:07.910811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15521): Terminating (SIGTERM) 11:47:07.953412 run iperf3-srv_10.42.42.10(pid=15522): Terminating (SIGTERM) 11:47:07.996689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15525): Terminating (SIGTERM) 11:47:08.040146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15528): Terminating (SIGTERM) 11:47:08.083634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15531): Terminating (SIGTERM) 11:47:08.126961 --- ParallelTerminationStrategy: PID 15521 died... 11:47:08.148024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15521): Terminated: ok {rc=0} 11:47:08.195505 --- ParallelTerminationStrategy: PID 15522 died... 11:47:08.215812 run iperf3-srv_10.42.42.10(pid=15522): Terminated {rc=256} 11:47:08.263750 --- ParallelTerminationStrategy: PID 15525 died... 11:47:08.284426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15525): Terminated: ok {rc=0} 11:47:08.331743 --- ParallelTerminationStrategy: PID 15528 died... 11:47:08.352512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15528): Terminated: ok {rc=0} 11:47:08.400006 --- ParallelTerminationStrategy: PID 15531 died... 11:47:08.420338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15531): Terminated: ok {rc=0} 11:47:08.509461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g iperf3m4.py ---------------------------------------------- 11:47:09.662578 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:09.674996 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:47:09.711682 tst iperf3m4.py: using LAC 33728 11:47:09.845357 tst iperf3m4.py: using RAC 68 11:47:09.978526 tst iperf3m4.py: using CellId 33728 11:47:10.112714 tst iperf3m4.py: using BVCI 33729 11:47:10.235783 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:10.246995 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:10.258003 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:10.268835 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:10.280089 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:10.291310 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:10.302650 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:10.313884 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:10.325144 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:47:10.448395 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:47:10.573665 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:47:10.697069 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:47:10.818290 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:47:11.047444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:11.389221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15533): Launched 11:47:11.686054 run iperf3-srv_10.42.42.10(pid=15534): Launched 11:47:11.814296 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:47:12.043878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:12.384119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15535): Launched 11:47:12.678686 run iperf3-srv_10.42.42.10(pid=15536): Launched 11:47:12.806739 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:47:13.035942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:13.375977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15537): Launched 11:47:13.669945 run iperf3-srv_10.42.42.10(pid=15538): Launched 11:47:13.797642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:47:14.026382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:14.366653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15539): Launched 11:47:14.662679 run iperf3-srv_10.42.42.10(pid=15540): Launched 11:47:14.790532 tst iperf3m4.py:8: start network... 11:47:15.019074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:15.541500 run create_hlr_db(pid=15541): Launched 11:47:15.671045 bus /gobi_6: Setting Powered False 11:47:16.734396 run create_hlr_db(pid=15541): Terminated: ok {rc=0} 11:47:17.211670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15543): Launched 11:47:17.534017 run osmo-hlr_10.42.42.2(pid=15544): Launched 11:47:17.654056 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:18.196778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15546): Launched 11:47:18.512321 run osmo-stp_10.42.42.5(pid=15547): Launched 11:47:18.633385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:19.178282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15549): Launched 11:47:19.299876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:19.566300 run patchelf(pid=15550): Launched 11:47:19.740577 run osmo-stp_10.42.42.5(pid=15547): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15547)] 11:47:19.872807 run osmo-stp_10.42.42.5(pid=15547): stdout: | (launched: 2022-12-13_11:47:18.453124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:20.006795 run osmo-stp_10.42.42.5(pid=15547): stderr: | 20221213114718628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114718628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114718628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114718629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114718629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114718629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114718629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:20.140404 run osmo-stp_10.42.42.5(pid=15547): stdout: | (launched: 2022-12-13_11:47:18.453124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:20.268293 run osmo-stp_10.42.42.5(pid=15547): stderr: | 20221213114718628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114718628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114718628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114718629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114718629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114718629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114718629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:20.419556 run patchelf(pid=15550): Terminating (SIGINT) 11:47:20.595046 run patchelf(pid=15550): Terminated: ok {rc=0} 11:47:20.721275 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15547): Process ended prematurely: osmo-stp_10.42.42.5(pid=15547) [trial-2389↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15547)] [trial-2389↪gprs:oc2g↪iperf3m4.py:8] 11:47:20.731025 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:47:20.759534 run osmo-hlr_10.42.42.2(pid=15544): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15544)] 11:47:20.807415 run osmo-hlr_10.42.42.2(pid=15544): stdout: | (launched: 2022-12-13_11:47:17.474427) 11:47:20.856912 run osmo-hlr_10.42.42.2(pid=15544): stderr: | 20221213114717654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114717654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114717654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114717655 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114717655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114717655 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114717667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114717675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114717675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114717675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:20.907061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15533): Terminating (SIGTERM) 11:47:20.947014 run iperf3-srv_10.42.42.10(pid=15534): Terminating (SIGTERM) 11:47:20.986877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15535): Terminating (SIGTERM) 11:47:21.026655 run iperf3-srv_10.42.42.10(pid=15536): Terminating (SIGTERM) 11:47:21.066264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15537): Terminating (SIGTERM) 11:47:21.105983 run iperf3-srv_10.42.42.10(pid=15538): Terminating (SIGTERM) 11:47:21.145457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15539): Terminating (SIGTERM) 11:47:21.185128 run iperf3-srv_10.42.42.10(pid=15540): Terminating (SIGTERM) 11:47:21.224437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15543): Terminating (SIGTERM) 11:47:21.264193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15546): Terminating (SIGTERM) 11:47:21.303704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15549): Terminating (SIGTERM) 11:47:21.343506 --- ParallelTerminationStrategy: PID 15533 died... 11:47:21.362850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15533): Terminated: ok {rc=0} 11:47:21.407142 --- ParallelTerminationStrategy: PID 15534 died... 11:47:21.425943 run iperf3-srv_10.42.42.10(pid=15534): Terminated {rc=256} 11:47:21.470114 --- ParallelTerminationStrategy: PID 15535 died... 11:47:21.489643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15535): Terminated: ok {rc=0} 11:47:21.533634 --- ParallelTerminationStrategy: PID 15536 died... 11:47:21.552335 run iperf3-srv_10.42.42.10(pid=15536): Terminated {rc=256} 11:47:21.596323 --- ParallelTerminationStrategy: PID 15537 died... 11:47:21.615124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15537): Terminated: ok {rc=0} 11:47:21.659114 --- ParallelTerminationStrategy: PID 15538 died... 11:47:21.677954 run iperf3-srv_10.42.42.10(pid=15538): Terminated {rc=256} 11:47:21.721914 --- ParallelTerminationStrategy: PID 15539 died... 11:47:21.740851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15539): Terminated: ok {rc=0} 11:47:21.784904 --- ParallelTerminationStrategy: PID 15540 died... 11:47:21.804327 run iperf3-srv_10.42.42.10(pid=15540): Terminated {rc=256} 11:47:21.849146 --- ParallelTerminationStrategy: PID 15543 died... 11:47:21.867927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15543): Terminated: ok {rc=0} 11:47:21.911827 --- ParallelTerminationStrategy: PID 15546 died... 11:47:21.930640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15546): Terminated: ok {rc=0} 11:47:21.974532 --- ParallelTerminationStrategy: PID 15549 died... 11:47:21.993501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15549): Terminated: ok {rc=0} 11:47:22.079426 bus /gobi_4: Setting Powered False 11:47:23.179031 bus /gobi_4: Setting Powered False 11:47:24.295709 bus /gobi_1: Setting Powered False 11:47:25.395026 bus /gobi_1: Setting Powered False 11:47:26.511306 bus /gobi_0: Setting Powered False 11:47:27.611144 bus /gobi_0: Setting Powered False 11:47:28.728490 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g ping.py ---------------------------------------------- 11:47:29.831250 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:29.843171 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:47:29.879747 tst ping.py: using LAC 33729 11:47:30.000676 tst ping.py: using RAC 69 11:47:30.122987 tst ping.py: using CellId 33729 11:47:30.246546 tst ping.py: using BVCI 33730 11:47:30.359284 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:30.370042 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:30.380766 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:30.391215 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:30.401578 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:30.411970 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:30.422543 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:30.432833 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:47:30.553998 tst ping.py:19: start network... 11:47:30.779357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:31.332779 run create_hlr_db(pid=15551): Launched 11:47:31.518711 bus /gobi_6: Setting Powered False 11:47:32.580640 run create_hlr_db(pid=15551): Terminated: ok {rc=0} 11:47:33.054796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15553): Launched 11:47:33.388735 run osmo-hlr_10.42.42.2(pid=15554): Launched 11:47:33.516308 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:34.092886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15556): Launched 11:47:34.427976 run osmo-stp_10.42.42.5(pid=15557): Launched 11:47:34.555430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:35.128349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15559): Launched 11:47:35.256129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:35.537371 run patchelf(pid=15560): Launched 11:47:35.722083 run osmo-stp_10.42.42.5(pid=15557): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15557)] 11:47:35.862066 run osmo-stp_10.42.42.5(pid=15557): stdout: | (launched: 2022-12-13_11:47:34.365757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:36.003980 run osmo-stp_10.42.42.5(pid=15557): stderr: | 20221213114734562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114734562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114734563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114734563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114734563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114734563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114734564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:36.145116 run osmo-stp_10.42.42.5(pid=15557): stdout: | (launched: 2022-12-13_11:47:34.365757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:36.280072 run osmo-stp_10.42.42.5(pid=15557): stderr: | 20221213114734562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114734562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114734563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114734563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114734563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114734563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114734564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:36.440284 run patchelf(pid=15560): Terminating (SIGINT) 11:47:36.624082 run patchelf(pid=15560): Terminated: ok {rc=0} 11:47:36.757394 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15557): Process ended prematurely: osmo-stp_10.42.42.5(pid=15557) [trial-2389↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15557)] [trial-2389↪gprs:oc2g↪ping.py:22] 11:47:36.767337 tst ping.py:22: Test FAILED (6.9 sec) 11:47:36.795996 run osmo-hlr_10.42.42.2(pid=15554): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15554)] 11:47:36.847302 run osmo-hlr_10.42.42.2(pid=15554): stdout: | (launched: 2022-12-13_11:47:33.326511) 11:47:36.901587 run osmo-hlr_10.42.42.2(pid=15554): stderr: | 20221213114733527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114733527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114733527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114733527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114733527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114733527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114733540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114733548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114733548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114733548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:36.954442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15553): Terminating (SIGTERM) 11:47:36.997135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15556): Terminating (SIGTERM) 11:47:37.040080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15559): Terminating (SIGTERM) 11:47:37.083711 --- ParallelTerminationStrategy: PID 15553 died... 11:47:37.104491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15553): Terminated: ok {rc=0} 11:47:37.151628 --- ParallelTerminationStrategy: PID 15556 died... 11:47:37.171940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15556): Terminated: ok {rc=0} 11:47:37.219120 --- ParallelTerminationStrategy: PID 15559 died... 11:47:37.239390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15559): Terminated: ok {rc=0} 11:47:37.328730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 11:47:38.416939 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:38.428487 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:47:38.464870 tst ping_idle_ping.py: using LAC 33730 11:47:38.585333 tst ping_idle_ping.py: using RAC 70 11:47:38.705594 tst ping_idle_ping.py: using CellId 33730 11:47:38.825797 tst ping_idle_ping.py: using BVCI 33731 11:47:38.938235 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:38.948894 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:38.959553 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:38.970215 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:38.980591 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:38.991169 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:39.001808 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:47:39.012246 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:47:39.127765 tst ping_idle_ping.py:24: start network... 11:47:39.335094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:39.817676 run create_hlr_db(pid=15561): Launched 11:47:39.943347 bus /gobi_6: Setting Powered False 11:47:41.009142 run create_hlr_db(pid=15561): Terminated: ok {rc=0} 11:47:41.471285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15563): Launched 11:47:41.805607 run osmo-hlr_10.42.42.2(pid=15564): Launched 11:47:41.934155 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:42.507631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15566): Launched 11:47:42.842654 run osmo-stp_10.42.42.5(pid=15567): Launched 11:47:42.969200 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:43.543273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15569): Launched 11:47:43.670154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:43.951844 run patchelf(pid=15570): Launched 11:47:44.137032 run osmo-stp_10.42.42.5(pid=15567): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15567)] 11:47:44.276422 run osmo-stp_10.42.42.5(pid=15567): stdout: | (launched: 2022-12-13_11:47:42.780163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:44.417904 run osmo-stp_10.42.42.5(pid=15567): stderr: | 20221213114742978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114742978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114742978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114742979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114742981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114742981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114742981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:44.559598 run osmo-stp_10.42.42.5(pid=15567): stdout: | (launched: 2022-12-13_11:47:42.780163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:44.694906 run osmo-stp_10.42.42.5(pid=15567): stderr: | 20221213114742978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114742978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114742978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114742979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114742981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114742981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114742981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:44.855308 run patchelf(pid=15570): Terminating (SIGINT) 11:47:45.040333 run patchelf(pid=15570): Terminated: ok {rc=0} 11:47:45.173325 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15567): Process ended prematurely: osmo-stp_10.42.42.5(pid=15567) [trial-2389↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15567)] [trial-2389↪gprs:oc2g↪ping_idle_ping.py:27] 11:47:45.183142 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:47:45.211729 run osmo-hlr_10.42.42.2(pid=15564): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15564)] 11:47:45.262917 run osmo-hlr_10.42.42.2(pid=15564): stdout: | (launched: 2022-12-13_11:47:41.743292) 11:47:45.315402 run osmo-hlr_10.42.42.2(pid=15564): stderr: | 20221213114741946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114741946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114741947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114741947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114741947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114741947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114741959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114741967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114741968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114741968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:45.368548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15563): Terminating (SIGTERM) 11:47:45.411738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15566): Terminating (SIGTERM) 11:47:45.454865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15569): Terminating (SIGTERM) 11:47:45.498244 --- ParallelTerminationStrategy: PID 15563 died... 11:47:45.519173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15563): Terminated: ok {rc=0} 11:47:45.565905 --- ParallelTerminationStrategy: PID 15566 died... 11:47:45.585937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15566): Terminated: ok {rc=0} 11:47:45.632291 --- ParallelTerminationStrategy: PID 15569 died... 11:47:45.652310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15569): Terminated: ok {rc=0} 11:47:45.740615 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 11:47:47.047216 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:47:47.061250 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:47:47.083138 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:47:47.128232 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:47:47.224176 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:47:47.246381 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:47:47.288280 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:47:47.879023 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:47:47.934095 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:47.945381 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:47:47.982359 tst cs_paging_gprs_active.py: using LAC 33731 11:47:48.103472 tst cs_paging_gprs_active.py: using RAC 71 11:47:48.225399 tst cs_paging_gprs_active.py: using CellId 33731 11:47:48.346428 tst cs_paging_gprs_active.py: using BVCI 33732 11:47:48.459850 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:48.470857 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:48.481705 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:48.492305 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:48.502789 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:48.513284 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:48.524049 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:48.534639 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:47:48.545329 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:47:48.669398 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:47:48.787345 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:47:48.996438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:49.309261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15576): Launched 11:47:49.579790 run iperf3-srv_10.42.42.10(pid=15577): Launched 11:47:49.697418 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:47:49.904269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:47:50.216076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15578): Launched 11:47:50.488063 run iperf3-srv_10.42.42.10(pid=15579): Launched 11:47:50.605126 tst cs_paging_gprs_active.py:38: start network... 11:47:50.811230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:51.295608 run create_hlr_db(pid=15580): Launched 11:47:51.423312 bus /gobi_6: Setting Powered False 11:47:52.484771 run create_hlr_db(pid=15580): Terminated: ok {rc=0} 11:47:52.917799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15582): Launched 11:47:53.229948 run osmo-hlr_10.42.42.2(pid=15583): Launched 11:47:53.347281 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:53.895717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15585): Launched 11:47:54.206961 run osmo-stp_10.42.42.5(pid=15586): Launched 11:47:54.326858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:47:54.861869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15588): Launched 11:47:54.982101 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:47:55.245999 run patchelf(pid=15589): Launched 11:47:55.419101 run osmo-stp_10.42.42.5(pid=15586): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15586)] 11:47:55.549681 run osmo-stp_10.42.42.5(pid=15586): stdout: | (launched: 2022-12-13_11:47:54.148753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:55.682380 run osmo-stp_10.42.42.5(pid=15586): stderr: | 20221213114754319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114754319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114754319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114754320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114754322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114754322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114754322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:55.815217 run osmo-stp_10.42.42.5(pid=15586): stdout: | (launched: 2022-12-13_11:47:54.148753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:55.941522 run osmo-stp_10.42.42.5(pid=15586): stderr: | 20221213114754319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114754319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114754319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114754320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114754322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114754322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114754322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:56.090853 run patchelf(pid=15589): Terminating (SIGINT) 11:47:56.264221 run patchelf(pid=15589): Terminated: ok {rc=0} 11:47:56.389362 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15586): Process ended prematurely: osmo-stp_10.42.42.5(pid=15586) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15586)] [trial-2389↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:47:56.398941 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:47:56.426231 run osmo-hlr_10.42.42.2(pid=15583): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15583)] 11:47:56.474304 run osmo-hlr_10.42.42.2(pid=15583): stdout: | (launched: 2022-12-13_11:47:53.171297) 11:47:56.524107 run osmo-hlr_10.42.42.2(pid=15583): stderr: | 20221213114753351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114753351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114753351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114753351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114753351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114753351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114753364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114753372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114753373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114753373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:56.574363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15576): Terminating (SIGTERM) 11:47:56.614604 run iperf3-srv_10.42.42.10(pid=15577): Terminating (SIGTERM) 11:47:56.654885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15578): Terminating (SIGTERM) 11:47:56.694974 run iperf3-srv_10.42.42.10(pid=15579): Terminating (SIGTERM) 11:47:56.734853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15582): Terminating (SIGTERM) 11:47:56.774893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15585): Terminating (SIGTERM) 11:47:56.814902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15588): Terminating (SIGTERM) 11:47:56.855315 --- ParallelTerminationStrategy: PID 15576 died... 11:47:56.874521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15576): Terminated: ok {rc=0} 11:47:56.918888 --- ParallelTerminationStrategy: PID 15577 died... 11:47:56.937485 run iperf3-srv_10.42.42.10(pid=15577): Terminated {rc=256} 11:47:56.981203 --- ParallelTerminationStrategy: PID 15578 died... 11:47:56.999739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15578): Terminated: ok {rc=0} 11:47:57.044295 --- ParallelTerminationStrategy: PID 15579 died... 11:47:57.063040 run iperf3-srv_10.42.42.10(pid=15579): Terminated {rc=256} 11:47:57.106815 --- ParallelTerminationStrategy: PID 15582 died... 11:47:57.125323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15582): Terminated: ok {rc=0} 11:47:57.169132 --- ParallelTerminationStrategy: PID 15585 died... 11:47:57.188046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15585): Terminated: ok {rc=0} 11:47:57.231695 --- ParallelTerminationStrategy: PID 15588 died... 11:47:57.250535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15588): Terminated: ok {rc=0} 11:47:57.336520 bus /gobi_0: Setting Powered False 11:47:58.437379 bus /gobi_0: Setting Powered False 11:47:59.554619 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:48:00.706795 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:00.719128 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:48:00.757758 tst iperf3.py: using LAC 33732 11:48:00.889929 tst iperf3.py: using RAC 72 11:48:01.033090 tst iperf3.py: using CellId 33732 11:48:01.162883 tst iperf3.py: using BVCI 33733 11:48:01.285471 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:01.298066 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:01.310758 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:01.323236 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:01.336421 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:01.349785 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:01.363291 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:01.376543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:01.390198 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:48:01.520233 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:48:01.784006 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:02.107759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15590): Launched 11:48:02.394879 run iperf3-srv_10.42.42.10(pid=15591): Launched 11:48:02.511840 tst iperf3.py:8: start network... 11:48:02.719709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:03.200107 run create_hlr_db(pid=15592): Launched 11:48:03.326428 bus /gobi_6: Setting Powered False 11:48:04.388025 run create_hlr_db(pid=15592): Terminated: ok {rc=0} 11:48:04.838289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15594): Launched 11:48:05.169898 run osmo-hlr_10.42.42.2(pid=15595): Launched 11:48:05.295677 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:05.863402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15597): Launched 11:48:06.195895 run osmo-stp_10.42.42.5(pid=15598): Launched 11:48:06.322685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:06.892892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15600): Launched 11:48:07.020337 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:07.300669 run patchelf(pid=15601): Launched 11:48:07.484634 run osmo-stp_10.42.42.5(pid=15598): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15598)] 11:48:07.624632 run osmo-stp_10.42.42.5(pid=15598): stdout: | (launched: 2022-12-13_11:48:06.134297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:07.766263 run osmo-stp_10.42.42.5(pid=15598): stderr: | 20221213114806328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114806328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114806328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114806329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114806329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114806329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114806329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:07.908201 run osmo-stp_10.42.42.5(pid=15598): stdout: | (launched: 2022-12-13_11:48:06.134297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:08.043546 run osmo-stp_10.42.42.5(pid=15598): stderr: | 20221213114806328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114806328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114806328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114806329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114806329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114806329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114806329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:08.203793 run patchelf(pid=15601): Terminating (SIGINT) 11:48:08.388261 run patchelf(pid=15601): Terminated: ok {rc=0} 11:48:08.521463 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15598): Process ended prematurely: osmo-stp_10.42.42.5(pid=15598) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15598)] [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 11:48:08.531939 tst iperf3.py:8: Test FAILED (7.9 sec) 11:48:08.560699 run osmo-hlr_10.42.42.2(pid=15595): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15595)] 11:48:08.612178 run osmo-hlr_10.42.42.2(pid=15595): stdout: | (launched: 2022-12-13_11:48:05.108149) 11:48:08.664809 run osmo-hlr_10.42.42.2(pid=15595): stderr: | 20221213114805310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114805310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114805310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114805310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114805310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114805310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114805323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114805331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114805331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114805331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:08.718054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15590): Terminating (SIGTERM) 11:48:08.760777 run iperf3-srv_10.42.42.10(pid=15591): Terminating (SIGTERM) 11:48:08.803536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15594): Terminating (SIGTERM) 11:48:08.846815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15597): Terminating (SIGTERM) 11:48:08.889552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15600): Terminating (SIGTERM) 11:48:08.932938 --- ParallelTerminationStrategy: PID 15590 died... 11:48:08.953744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15590): Terminated: ok {rc=0} 11:48:09.001253 --- ParallelTerminationStrategy: PID 15591 died... 11:48:09.021427 run iperf3-srv_10.42.42.10(pid=15591): Terminated {rc=256} 11:48:09.068670 --- ParallelTerminationStrategy: PID 15594 died... 11:48:09.089029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15594): Terminated: ok {rc=0} 11:48:09.136086 --- ParallelTerminationStrategy: PID 15597 died... 11:48:09.156604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15597): Terminated: ok {rc=0} 11:48:09.203887 --- ParallelTerminationStrategy: PID 15600 died... 11:48:09.223979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15600): Terminated: ok {rc=0} 11:48:09.314769 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:48:10.465728 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:10.477593 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:48:10.514789 tst iperf3m4.py: using LAC 33733 11:48:10.638346 tst iperf3m4.py: using RAC 73 11:48:10.760873 tst iperf3m4.py: using CellId 33733 11:48:10.881186 tst iperf3m4.py: using BVCI 33734 11:48:10.993490 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:11.004378 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:11.015109 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:11.025792 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:11.036349 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:11.047514 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:11.058881 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:11.070005 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:11.080810 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:48:11.200759 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:48:11.318571 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:48:11.437077 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:48:11.556428 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:48:11.764761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:12.077571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15602): Launched 11:48:12.349393 run iperf3-srv_10.42.42.10(pid=15603): Launched 11:48:12.465481 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:48:12.674237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:12.987991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15604): Launched 11:48:13.260592 run iperf3-srv_10.42.42.10(pid=15605): Launched 11:48:13.378066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:48:13.586210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:13.898586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15606): Launched 11:48:14.169271 run iperf3-srv_10.42.42.10(pid=15607): Launched 11:48:14.286492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:48:14.493590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:14.805580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15608): Launched 11:48:15.077575 run iperf3-srv_10.42.42.10(pid=15609): Launched 11:48:15.195533 tst iperf3m4.py:8: start network... 11:48:15.403965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:15.892390 run create_hlr_db(pid=15610): Launched 11:48:16.067677 bus /gobi_6: Setting Powered False 11:48:17.132550 run create_hlr_db(pid=15610): Terminated: ok {rc=0} 11:48:17.579172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15612): Launched 11:48:17.892422 run osmo-hlr_10.42.42.2(pid=15613): Launched 11:48:18.011495 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:18.550160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15615): Launched 11:48:18.862901 run osmo-stp_10.42.42.5(pid=15616): Launched 11:48:18.981609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:19.515788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15618): Launched 11:48:19.637126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:19.900621 run patchelf(pid=15619): Launched 11:48:20.074445 run osmo-stp_10.42.42.5(pid=15616): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15616)] 11:48:20.205189 run osmo-stp_10.42.42.5(pid=15616): stdout: | (launched: 2022-12-13_11:48:18.804258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:20.337514 run osmo-stp_10.42.42.5(pid=15616): stderr: | 20221213114818977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114818977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114818977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114818978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114818978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114818978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114818978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:20.470218 run osmo-stp_10.42.42.5(pid=15616): stdout: | (launched: 2022-12-13_11:48:18.804258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:20.596425 run osmo-stp_10.42.42.5(pid=15616): stderr: | 20221213114818977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114818977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114818977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114818978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114818978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114818978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114818978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:20.746111 run patchelf(pid=15619): Terminating (SIGINT) 11:48:20.919013 run patchelf(pid=15619): Terminated: ok {rc=0} 11:48:21.043964 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15616): Process ended prematurely: osmo-stp_10.42.42.5(pid=15616) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15616)] [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 11:48:21.053814 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:48:21.081241 run osmo-hlr_10.42.42.2(pid=15613): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15613)] 11:48:21.129123 run osmo-hlr_10.42.42.2(pid=15613): stdout: | (launched: 2022-12-13_11:48:17.834005) 11:48:21.178670 run osmo-hlr_10.42.42.2(pid=15613): stderr: | 20221213114818014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114818014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114818014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114818014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114818015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114818015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114818027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114818036 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114818036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114818036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:21.228808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15602): Terminating (SIGTERM) 11:48:21.269085 run iperf3-srv_10.42.42.10(pid=15603): Terminating (SIGTERM) 11:48:21.308488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15604): Terminating (SIGTERM) 11:48:21.348456 run iperf3-srv_10.42.42.10(pid=15605): Terminating (SIGTERM) 11:48:21.388320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15606): Terminating (SIGTERM) 11:48:21.427987 run iperf3-srv_10.42.42.10(pid=15607): Terminating (SIGTERM) 11:48:21.467640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15608): Terminating (SIGTERM) 11:48:21.507427 run iperf3-srv_10.42.42.10(pid=15609): Terminating (SIGTERM) 11:48:21.547334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15612): Terminating (SIGTERM) 11:48:21.587239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15615): Terminating (SIGTERM) 11:48:21.627188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15618): Terminating (SIGTERM) 11:48:21.667267 --- ParallelTerminationStrategy: PID 15602 died... 11:48:21.686649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15602): Terminated: ok {rc=0} 11:48:21.731024 --- ParallelTerminationStrategy: PID 15603 died... 11:48:21.749838 run iperf3-srv_10.42.42.10(pid=15603): Terminated {rc=256} 11:48:21.793887 --- ParallelTerminationStrategy: PID 15604 died... 11:48:21.812742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15604): Terminated: ok {rc=0} 11:48:21.856552 --- ParallelTerminationStrategy: PID 15605 died... 11:48:21.875179 run iperf3-srv_10.42.42.10(pid=15605): Terminated {rc=256} 11:48:21.919040 --- ParallelTerminationStrategy: PID 15606 died... 11:48:21.937837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15606): Terminated: ok {rc=0} 11:48:21.981799 --- ParallelTerminationStrategy: PID 15607 died... 11:48:22.000620 run iperf3-srv_10.42.42.10(pid=15607): Terminated {rc=256} 11:48:22.044457 --- ParallelTerminationStrategy: PID 15608 died... 11:48:22.062990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15608): Terminated: ok {rc=0} 11:48:22.107157 --- ParallelTerminationStrategy: PID 15609 died... 11:48:22.125942 run iperf3-srv_10.42.42.10(pid=15609): Terminated {rc=256} 11:48:22.169794 --- ParallelTerminationStrategy: PID 15612 died... 11:48:22.188413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15612): Terminated: ok {rc=0} 11:48:22.232185 --- ParallelTerminationStrategy: PID 15615 died... 11:48:22.250995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15615): Terminated: ok {rc=0} 11:48:22.294878 --- ParallelTerminationStrategy: PID 15618 died... 11:48:22.313767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15618): Terminated: ok {rc=0} 11:48:22.399772 bus /gobi_4: Setting Powered False 11:48:23.500193 bus /gobi_4: Setting Powered False 11:48:24.615957 bus /gobi_1: Setting Powered False 11:48:25.715691 bus /gobi_1: Setting Powered False 11:48:26.830021 bus /gobi_0: Setting Powered False 11:48:27.929485 bus /gobi_0: Setting Powered False 11:48:29.045082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 11:48:30.145852 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:30.157482 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:48:30.195632 tst ping.py: using LAC 33734 11:48:30.319100 tst ping.py: using RAC 74 11:48:30.436199 tst ping.py: using CellId 33734 11:48:30.553061 tst ping.py: using BVCI 33735 11:48:30.662428 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:30.673917 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:30.684569 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:30.695414 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:30.706248 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:30.717045 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:30.728004 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:30.739521 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:48:30.854255 tst ping.py:19: start network... 11:48:31.103012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:31.625239 run create_hlr_db(pid=15620): Launched 11:48:31.777782 bus /gobi_6: Setting Powered False 11:48:32.837727 run create_hlr_db(pid=15620): Terminated: ok {rc=0} 11:48:33.281636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15622): Launched 11:48:33.610122 run osmo-hlr_10.42.42.2(pid=15623): Launched 11:48:33.735319 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:34.297707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15625): Launched 11:48:34.603741 run osmo-stp_10.42.42.5(pid=15626): Launched 11:48:34.720722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:35.245105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15628): Launched 11:48:35.362606 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:35.619703 run patchelf(pid=15629): Launched 11:48:35.788910 run osmo-stp_10.42.42.5(pid=15626): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15626)] 11:48:35.917796 run osmo-stp_10.42.42.5(pid=15626): stdout: | (launched: 2022-12-13_11:48:34.546100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:36.048149 run osmo-stp_10.42.42.5(pid=15626): stderr: | 20221213114834719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114834719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114834719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114834720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114834720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114834720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114834720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:36.178630 run osmo-stp_10.42.42.5(pid=15626): stdout: | (launched: 2022-12-13_11:48:34.546100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:36.302858 run osmo-stp_10.42.42.5(pid=15626): stderr: | 20221213114834719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114834719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114834719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114834720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114834720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114834720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114834720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:36.450381 run patchelf(pid=15629): Terminating (SIGINT) 11:48:36.619847 run patchelf(pid=15629): Terminated: ok {rc=0} 11:48:36.742222 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15626): Process ended prematurely: osmo-stp_10.42.42.5(pid=15626) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15626)] [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 11:48:36.751187 tst ping.py:22: Test FAILED (6.6 sec) 11:48:36.778640 run osmo-hlr_10.42.42.2(pid=15623): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15623)] 11:48:36.827397 run osmo-hlr_10.42.42.2(pid=15623): stdout: | (launched: 2022-12-13_11:48:33.548839) 11:48:36.877716 run osmo-hlr_10.42.42.2(pid=15623): stderr: | 20221213114833748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114833748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114833748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114833748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114833748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114833748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114833760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114833769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114833769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114833769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:36.928381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15622): Terminating (SIGTERM) 11:48:36.968689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15625): Terminating (SIGTERM) 11:48:37.009139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15628): Terminating (SIGTERM) 11:48:37.049783 --- ParallelTerminationStrategy: PID 15622 died... 11:48:37.069525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15622): Terminated: ok {rc=0} 11:48:37.114322 --- ParallelTerminationStrategy: PID 15625 died... 11:48:37.133451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15625): Terminated: ok {rc=0} 11:48:37.177722 --- ParallelTerminationStrategy: PID 15628 died... 11:48:37.196607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15628): Terminated: ok {rc=0} 11:48:37.283423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:48:38.370563 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:38.382357 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:48:38.420022 tst ping_idle_ping.py: using LAC 33735 11:48:38.548292 tst ping_idle_ping.py: using RAC 75 11:48:38.675778 tst ping_idle_ping.py: using CellId 33735 11:48:38.797269 tst ping_idle_ping.py: using BVCI 33736 11:48:38.908773 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:38.919834 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:38.930729 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:38.941804 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:38.952842 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:38.964217 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:38.975558 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:48:38.986915 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:48:39.104354 tst ping_idle_ping.py:24: start network... 11:48:39.308395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:39.784899 run create_hlr_db(pid=15630): Launched 11:48:39.912089 bus /gobi_6: Setting Powered False 11:48:40.973370 run create_hlr_db(pid=15630): Terminated: ok {rc=0} 11:48:41.402245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15632): Launched 11:48:41.709800 run osmo-hlr_10.42.42.2(pid=15633): Launched 11:48:41.828848 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:42.359798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15635): Launched 11:48:42.669066 run osmo-stp_10.42.42.5(pid=15636): Launched 11:48:42.785086 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:43.313609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15638): Launched 11:48:43.430610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:43.690167 run patchelf(pid=15639): Launched 11:48:43.860436 run osmo-stp_10.42.42.5(pid=15636): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15636)] 11:48:43.990337 run osmo-stp_10.42.42.5(pid=15636): stdout: | (launched: 2022-12-13_11:48:42.610873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:44.121739 run osmo-stp_10.42.42.5(pid=15636): stderr: | 20221213114842784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114842784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114842785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114842785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114842786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114842786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114842786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:44.253342 run osmo-stp_10.42.42.5(pid=15636): stdout: | (launched: 2022-12-13_11:48:42.610873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:44.378445 run osmo-stp_10.42.42.5(pid=15636): stderr: | 20221213114842784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114842784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114842785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114842785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114842786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114842786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114842786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:44.527190 run patchelf(pid=15639): Terminating (SIGINT) 11:48:44.698390 run patchelf(pid=15639): Terminated: ok {rc=0} 11:48:44.821592 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15636): Process ended prematurely: osmo-stp_10.42.42.5(pid=15636) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15636)] [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 11:48:44.830845 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:48:44.857996 run osmo-hlr_10.42.42.2(pid=15633): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15633)] 11:48:44.906374 run osmo-hlr_10.42.42.2(pid=15633): stdout: | (launched: 2022-12-13_11:48:41.651795) 11:48:44.956396 run osmo-hlr_10.42.42.2(pid=15633): stderr: | 20221213114841830 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114841830 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114841830 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114841830 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114841830 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114841830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114841842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114841852 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114841853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114841853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:45.007005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15632): Terminating (SIGTERM) 11:48:45.047575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15635): Terminating (SIGTERM) 11:48:45.087867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15638): Terminating (SIGTERM) 11:48:45.128701 --- ParallelTerminationStrategy: PID 15632 died... 11:48:45.147824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15632): Terminated: ok {rc=0} 11:48:45.192638 --- ParallelTerminationStrategy: PID 15635 died... 11:48:45.211629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15635): Terminated: ok {rc=0} 11:48:45.255967 --- ParallelTerminationStrategy: PID 15638 died... 11:48:45.274774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15638): Terminated: ok {rc=0} 11:48:45.359511 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:48:46.681818 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:48:46.689399 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:48:46.712194 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:48:46.753253 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:48:46.849898 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:48:46.880099 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:48:46.924033 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:48:47.505940 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:48:47.561865 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:47.573255 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:48:47.632331 tst cs_paging_gprs_active.py: using LAC 33736 11:48:47.762155 tst cs_paging_gprs_active.py: using RAC 76 11:48:47.896631 tst cs_paging_gprs_active.py: using CellId 33736 11:48:48.027737 tst cs_paging_gprs_active.py: using BVCI 33737 11:48:48.150245 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:48.161801 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:48.172857 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:48.184068 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:48.195418 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:48.206950 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:48.218622 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:48.230093 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:48:48.241739 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:48:48.359564 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:48:48.480152 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:48:48.704889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:49.039380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15643): Launched 11:48:49.328915 run iperf3-srv_10.42.42.10(pid=15644): Launched 11:48:49.448701 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:48:49.658658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:49.972661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15645): Launched 11:48:50.247177 run iperf3-srv_10.42.42.10(pid=15646): Launched 11:48:50.365451 tst cs_paging_gprs_active.py:38: start network... 11:48:50.574745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:51.059814 run create_hlr_db(pid=15647): Launched 11:48:51.189136 bus /gobi_6: Setting Powered False 11:48:52.250752 run create_hlr_db(pid=15647): Terminated: ok {rc=0} 11:48:52.706224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15649): Launched 11:48:53.041080 run osmo-hlr_10.42.42.2(pid=15650): Launched 11:48:53.170892 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:53.746639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15652): Launched 11:48:54.079763 run osmo-stp_10.42.42.5(pid=15653): Launched 11:48:54.207824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:54.782077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15655): Launched 11:48:54.910705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:55.193393 run patchelf(pid=15656): Launched 11:48:55.379665 run osmo-stp_10.42.42.5(pid=15653): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15653)] 11:48:55.520244 run osmo-stp_10.42.42.5(pid=15653): stdout: | (launched: 2022-12-13_11:48:54.017793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:55.663395 run osmo-stp_10.42.42.5(pid=15653): stderr: | 20221213114854214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114854214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114854214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114854215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114854215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114854215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114854215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:55.806179 run osmo-stp_10.42.42.5(pid=15653): stdout: | (launched: 2022-12-13_11:48:54.017793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:55.942245 run osmo-stp_10.42.42.5(pid=15653): stderr: | 20221213114854214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114854214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114854214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114854215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114854215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114854215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114854215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:56.103518 run patchelf(pid=15656): Terminating (SIGINT) 11:48:56.289952 run patchelf(pid=15656): Terminated: ok {rc=0} 11:48:56.424242 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15653): Process ended prematurely: osmo-stp_10.42.42.5(pid=15653) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15653)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:48:56.434616 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:48:56.463608 run osmo-hlr_10.42.42.2(pid=15650): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15650)] 11:48:56.514866 run osmo-hlr_10.42.42.2(pid=15650): stdout: | (launched: 2022-12-13_11:48:52.978827) 11:48:56.567471 run osmo-hlr_10.42.42.2(pid=15650): stderr: | 20221213114853178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114853178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114853178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114853178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114853178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114853179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114853190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114853199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114853199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114853199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:56.620780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15643): Terminating (SIGTERM) 11:48:56.663627 run iperf3-srv_10.42.42.10(pid=15644): Terminating (SIGTERM) 11:48:56.706847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15645): Terminating (SIGTERM) 11:48:56.750282 run iperf3-srv_10.42.42.10(pid=15646): Terminating (SIGTERM) 11:48:56.792847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15649): Terminating (SIGTERM) 11:48:56.836218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15652): Terminating (SIGTERM) 11:48:56.878712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15655): Terminating (SIGTERM) 11:48:56.921757 --- ParallelTerminationStrategy: PID 15643 died... 11:48:56.942354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15643): Terminated: ok {rc=0} 11:48:56.989460 --- ParallelTerminationStrategy: PID 15644 died... 11:48:57.009473 run iperf3-srv_10.42.42.10(pid=15644): Terminated {rc=256} 11:48:57.056171 --- ParallelTerminationStrategy: PID 15645 died... 11:48:57.076182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15645): Terminated: ok {rc=0} 11:48:57.122852 --- ParallelTerminationStrategy: PID 15646 died... 11:48:57.142746 run iperf3-srv_10.42.42.10(pid=15646): Terminated {rc=256} 11:48:57.189316 --- ParallelTerminationStrategy: PID 15649 died... 11:48:57.209454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15649): Terminated: ok {rc=0} 11:48:57.256247 --- ParallelTerminationStrategy: PID 15652 died... 11:48:57.276272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15652): Terminated: ok {rc=0} 11:48:57.322954 --- ParallelTerminationStrategy: PID 15655 died... 11:48:57.343001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15655): Terminated: ok {rc=0} 11:48:57.432441 bus /gobi_0: Setting Powered False 11:48:58.531284 bus /gobi_0: Setting Powered False 11:48:59.650146 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:49:00.803693 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:00.815730 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:49:00.892318 tst iperf3.py: using LAC 33737 11:49:01.038942 tst iperf3.py: using RAC 77 11:49:01.161691 tst iperf3.py: using CellId 33737 11:49:01.297129 tst iperf3.py: using BVCI 33738 11:49:01.459978 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:01.472403 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:01.483934 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:01.495963 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:01.508100 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:01.519821 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:01.532419 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:01.544938 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:01.557233 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:49:01.681043 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:49:01.896350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:02.222025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15658): Launched 11:49:02.507833 run iperf3-srv_10.42.42.10(pid=15659): Launched 11:49:02.625445 tst iperf3.py:8: start network... 11:49:02.833342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:03.312679 run create_hlr_db(pid=15660): Launched 11:49:03.440857 bus /gobi_6: Setting Powered False 11:49:04.501985 run create_hlr_db(pid=15660): Terminated: ok {rc=0} 11:49:04.935019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15662): Launched 11:49:05.244939 run osmo-hlr_10.42.42.2(pid=15663): Launched 11:49:05.363074 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:05.896755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15665): Launched 11:49:06.207985 run osmo-stp_10.42.42.5(pid=15666): Launched 11:49:06.326694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:06.859328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15668): Launched 11:49:06.978787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:07.241555 run patchelf(pid=15669): Launched 11:49:07.412918 run osmo-stp_10.42.42.5(pid=15666): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15666)] 11:49:07.544591 run osmo-stp_10.42.42.5(pid=15666): stdout: | (launched: 2022-12-13_11:49:06.149719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:07.678344 run osmo-stp_10.42.42.5(pid=15666): stderr: | 20221213114906325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114906325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114906325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114906326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114906326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114906326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114906326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:07.811296 run osmo-stp_10.42.42.5(pid=15666): stdout: | (launched: 2022-12-13_11:49:06.149719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:07.938157 run osmo-stp_10.42.42.5(pid=15666): stderr: | 20221213114906325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114906325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114906325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114906326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114906326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114906326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114906326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:08.088732 run patchelf(pid=15669): Terminating (SIGINT) 11:49:08.262733 run patchelf(pid=15669): Terminated: ok {rc=0} 11:49:08.388250 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15666): Process ended prematurely: osmo-stp_10.42.42.5(pid=15666) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15666)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 11:49:08.398063 tst iperf3.py:8: Test FAILED (7.6 sec) 11:49:08.425091 run osmo-hlr_10.42.42.2(pid=15663): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15663)] 11:49:08.472894 run osmo-hlr_10.42.42.2(pid=15663): stdout: | (launched: 2022-12-13_11:49:05.186663) 11:49:08.522272 run osmo-hlr_10.42.42.2(pid=15663): stderr: | 20221213114905367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114905367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114905367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114905367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114905367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114905367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114905379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114905389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114905389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114905389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:08.572215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15658): Terminating (SIGTERM) 11:49:08.612304 run iperf3-srv_10.42.42.10(pid=15659): Terminating (SIGTERM) 11:49:08.652212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15662): Terminating (SIGTERM) 11:49:08.692322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15665): Terminating (SIGTERM) 11:49:08.732275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15668): Terminating (SIGTERM) 11:49:08.772887 --- ParallelTerminationStrategy: PID 15658 died... 11:49:08.792387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15658): Terminated: ok {rc=0} 11:49:08.837186 --- ParallelTerminationStrategy: PID 15659 died... 11:49:08.856016 run iperf3-srv_10.42.42.10(pid=15659): Terminated {rc=256} 11:49:08.899579 --- ParallelTerminationStrategy: PID 15662 died... 11:49:08.918286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15662): Terminated: ok {rc=0} 11:49:08.962082 --- ParallelTerminationStrategy: PID 15665 died... 11:49:08.980740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15665): Terminated: ok {rc=0} 11:49:09.024347 --- ParallelTerminationStrategy: PID 15668 died... 11:49:09.043327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15668): Terminated: ok {rc=0} 11:49:09.130778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:49:10.278925 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:10.290455 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:49:10.348184 tst iperf3m4.py: using LAC 33738 11:49:10.471690 tst iperf3m4.py: using RAC 78 11:49:10.593932 tst iperf3m4.py: using CellId 33738 11:49:10.725456 tst iperf3m4.py: using BVCI 33739 11:49:10.837918 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:10.848840 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:10.859660 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:10.870349 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:10.880901 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:10.892075 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:10.904252 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:10.915665 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:10.927232 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:49:11.047891 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:49:11.168573 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:49:11.289616 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:49:11.410889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:49:11.619952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:11.934678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15670): Launched 11:49:12.210076 run iperf3-srv_10.42.42.10(pid=15671): Launched 11:49:12.328175 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:49:12.536610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:12.850439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Launched 11:49:13.124796 run iperf3-srv_10.42.42.10(pid=15673): Launched 11:49:13.243629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:49:13.451188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:13.764663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15674): Launched 11:49:14.039404 run iperf3-srv_10.42.42.10(pid=15675): Launched 11:49:14.157460 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:49:14.365939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:14.679907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15676): Launched 11:49:14.955118 run iperf3-srv_10.42.42.10(pid=15677): Launched 11:49:15.072402 tst iperf3m4.py:8: start network... 11:49:15.281335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:15.763659 run create_hlr_db(pid=15678): Launched 11:49:15.891027 bus /gobi_6: Setting Powered False 11:49:16.964685 run create_hlr_db(pid=15678): Terminated: ok {rc=0} 11:49:17.403282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15680): Launched 11:49:17.716417 run osmo-hlr_10.42.42.2(pid=15681): Launched 11:49:17.836374 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:18.372229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15683): Launched 11:49:18.685377 run osmo-stp_10.42.42.5(pid=15684): Launched 11:49:18.805501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:19.342593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15686): Launched 11:49:19.463131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:19.728232 run patchelf(pid=15687): Launched 11:49:19.902646 run osmo-stp_10.42.42.5(pid=15684): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15684)] 11:49:20.034031 run osmo-stp_10.42.42.5(pid=15684): stdout: | (launched: 2022-12-13_11:49:18.626622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:20.167017 run osmo-stp_10.42.42.5(pid=15684): stderr: | 20221213114918800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114918800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114918800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114918800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114918801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114918801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114918801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:20.299795 run osmo-stp_10.42.42.5(pid=15684): stdout: | (launched: 2022-12-13_11:49:18.626622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:20.425903 run osmo-stp_10.42.42.5(pid=15684): stderr: | 20221213114918800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114918800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114918800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114918800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114918801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114918801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114918801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:20.575683 run patchelf(pid=15687): Terminating (SIGINT) 11:49:20.748767 run patchelf(pid=15687): Terminated: ok {rc=0} 11:49:20.874173 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15684): Process ended prematurely: osmo-stp_10.42.42.5(pid=15684) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15684)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:49:20.883780 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:49:20.911415 run osmo-hlr_10.42.42.2(pid=15681): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15681)] 11:49:20.959289 run osmo-hlr_10.42.42.2(pid=15681): stdout: | (launched: 2022-12-13_11:49:17.656851) 11:49:21.008936 run osmo-hlr_10.42.42.2(pid=15681): stderr: | 20221213114917836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114917836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114917836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114917836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114917836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114917836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114917848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114917856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114917856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114917857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:21.059096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15670): Terminating (SIGTERM) 11:49:21.099347 run iperf3-srv_10.42.42.10(pid=15671): Terminating (SIGTERM) 11:49:21.139337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Terminating (SIGTERM) 11:49:21.179648 run iperf3-srv_10.42.42.10(pid=15673): Terminating (SIGTERM) 11:49:21.219704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15674): Terminating (SIGTERM) 11:49:21.259867 run iperf3-srv_10.42.42.10(pid=15675): Terminating (SIGTERM) 11:49:21.299975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15676): Terminating (SIGTERM) 11:49:21.339972 run iperf3-srv_10.42.42.10(pid=15677): Terminating (SIGTERM) 11:49:21.379924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15680): Terminating (SIGTERM) 11:49:21.420032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15683): Terminating (SIGTERM) 11:49:21.460036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15686): Terminating (SIGTERM) 11:49:21.500330 --- ParallelTerminationStrategy: PID 15670 died... 11:49:21.519920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15670): Terminated: ok {rc=0} 11:49:21.564818 --- ParallelTerminationStrategy: PID 15671 died... 11:49:21.583846 run iperf3-srv_10.42.42.10(pid=15671): Terminated {rc=256} 11:49:21.628029 --- ParallelTerminationStrategy: PID 15672 died... 11:49:21.646916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Terminated: ok {rc=0} 11:49:21.691532 --- ParallelTerminationStrategy: PID 15673 died... 11:49:21.710918 run iperf3-srv_10.42.42.10(pid=15673): Terminated {rc=256} 11:49:21.755495 --- ParallelTerminationStrategy: PID 15674 died... 11:49:21.774467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15674): Terminated: ok {rc=0} 11:49:21.818705 --- ParallelTerminationStrategy: PID 15675 died... 11:49:21.837599 run iperf3-srv_10.42.42.10(pid=15675): Terminated {rc=256} 11:49:21.881915 --- ParallelTerminationStrategy: PID 15676 died... 11:49:21.900679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15676): Terminated: ok {rc=0} 11:49:21.945264 --- ParallelTerminationStrategy: PID 15677 died... 11:49:21.964220 run iperf3-srv_10.42.42.10(pid=15677): Terminated {rc=256} 11:49:22.008458 --- ParallelTerminationStrategy: PID 15680 died... 11:49:22.027324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15680): Terminated: ok {rc=0} 11:49:22.071804 --- ParallelTerminationStrategy: PID 15683 died... 11:49:22.090789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15683): Terminated: ok {rc=0} 11:49:22.135159 --- ParallelTerminationStrategy: PID 15686 died... 11:49:22.154103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15686): Terminated: ok {rc=0} 11:49:22.240628 bus /gobi_4: Setting Powered False 11:49:23.341200 bus /gobi_4: Setting Powered False 11:49:24.457461 bus /gobi_1: Setting Powered False 11:49:25.557045 bus /gobi_1: Setting Powered False 11:49:26.670822 bus /gobi_0: Setting Powered False 11:49:27.769922 bus /gobi_0: Setting Powered False 11:49:28.888640 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:49:29.991001 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:30.003081 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:49:30.061765 tst ping.py: using LAC 33739 11:49:30.190744 tst ping.py: using RAC 79 11:49:30.319026 tst ping.py: using CellId 33739 11:49:30.446322 tst ping.py: using BVCI 33740 11:49:30.564185 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:30.575705 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:30.587055 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:30.598320 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:30.609904 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:30.621442 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:30.633136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:30.644551 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:49:30.760902 tst ping.py:19: start network... 11:49:30.968193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:31.449962 run create_hlr_db(pid=15688): Launched 11:49:31.611159 bus /gobi_6: Setting Powered False 11:49:32.675254 run create_hlr_db(pid=15688): Terminated: ok {rc=0} 11:49:33.113532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15690): Launched 11:49:33.421668 run osmo-hlr_10.42.42.2(pid=15691): Launched 11:49:33.537610 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:34.069633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15693): Launched 11:49:34.377360 run osmo-stp_10.42.42.5(pid=15694): Launched 11:49:34.493949 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:35.022554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15696): Launched 11:49:35.140269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:35.399698 run patchelf(pid=15697): Launched 11:49:35.572699 run osmo-stp_10.42.42.5(pid=15694): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15694)] 11:49:35.701823 run osmo-stp_10.42.42.5(pid=15694): stdout: | (launched: 2022-12-13_11:49:34.319636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:35.833357 run osmo-stp_10.42.42.5(pid=15694): stderr: | 20221213114934493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114934493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114934494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114934494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114934495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114934495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114934495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:35.964112 run osmo-stp_10.42.42.5(pid=15694): stdout: | (launched: 2022-12-13_11:49:34.319636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:36.088559 run osmo-stp_10.42.42.5(pid=15694): stderr: | 20221213114934493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114934493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114934494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114934494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114934495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114934495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114934495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:36.236404 run patchelf(pid=15697): Terminating (SIGINT) 11:49:36.406952 run patchelf(pid=15697): Terminated: ok {rc=0} 11:49:36.530016 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15694): Process ended prematurely: osmo-stp_10.42.42.5(pid=15694) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15694)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 11:49:36.539146 tst ping.py:22: Test FAILED (6.5 sec) 11:49:36.566157 run osmo-hlr_10.42.42.2(pid=15691): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15691)] 11:49:36.613989 run osmo-hlr_10.42.42.2(pid=15691): stdout: | (launched: 2022-12-13_11:49:33.363637) 11:49:36.663912 run osmo-hlr_10.42.42.2(pid=15691): stderr: | 20221213114933544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114933544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114933544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114933544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114933544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114933544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114933556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114933567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114933567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114933567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:36.714347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15690): Terminating (SIGTERM) 11:49:36.754653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15693): Terminating (SIGTERM) 11:49:36.795107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15696): Terminating (SIGTERM) 11:49:36.835962 --- ParallelTerminationStrategy: PID 15690 died... 11:49:36.855629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15690): Terminated: ok {rc=0} 11:49:36.900368 --- ParallelTerminationStrategy: PID 15693 died... 11:49:36.919486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15693): Terminated: ok {rc=0} 11:49:36.964174 --- ParallelTerminationStrategy: PID 15696 died... 11:49:36.983242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15696): Terminated: ok {rc=0} 11:49:37.069860 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:49:38.158426 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:38.170202 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:49:38.229349 tst ping_idle_ping.py: using LAC 33740 11:49:38.350505 tst ping_idle_ping.py: using RAC 80 11:49:38.471677 tst ping_idle_ping.py: using CellId 33740 11:49:38.592880 tst ping_idle_ping.py: using BVCI 33741 11:49:38.703605 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:38.714657 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:38.725438 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:38.736079 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:38.746756 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:38.757591 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:38.769153 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:49:38.780255 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:49:38.901065 tst ping_idle_ping.py:24: start network... 11:49:39.122647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:39.631342 run create_hlr_db(pid=15698): Launched 11:49:39.758014 bus /gobi_6: Setting Powered False 11:49:40.822781 run create_hlr_db(pid=15698): Terminated: ok {rc=0} 11:49:41.261234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15700): Launched 11:49:41.568587 run osmo-hlr_10.42.42.2(pid=15701): Launched 11:49:41.685994 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:42.215828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15703): Launched 11:49:42.524877 run osmo-stp_10.42.42.5(pid=15704): Launched 11:49:42.641393 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:43.170636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15706): Launched 11:49:43.288933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:43.548726 run patchelf(pid=15707): Launched 11:49:43.720513 run osmo-stp_10.42.42.5(pid=15704): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15704)] 11:49:43.850009 run osmo-stp_10.42.42.5(pid=15704): stdout: | (launched: 2022-12-13_11:49:42.466946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:43.981383 run osmo-stp_10.42.42.5(pid=15704): stderr: | 20221213114942640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114942641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114942641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114942641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114942642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114942642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114942642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:44.112757 run osmo-stp_10.42.42.5(pid=15704): stdout: | (launched: 2022-12-13_11:49:42.466946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:44.237834 run osmo-stp_10.42.42.5(pid=15704): stderr: | 20221213114942640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114942641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114942641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114942641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114942642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114942642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114942642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:44.386586 run patchelf(pid=15707): Terminating (SIGINT) 11:49:44.557296 run patchelf(pid=15707): Terminated: ok {rc=0} 11:49:44.680486 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15704): Process ended prematurely: osmo-stp_10.42.42.5(pid=15704) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15704)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:49:44.689598 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:49:44.716435 run osmo-hlr_10.42.42.2(pid=15701): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15701)] 11:49:44.764773 run osmo-hlr_10.42.42.2(pid=15701): stdout: | (launched: 2022-12-13_11:49:41.510782) 11:49:44.814567 run osmo-hlr_10.42.42.2(pid=15701): stderr: | 20221213114941688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114941688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114941688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114941688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114941688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114941688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114941729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114941740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114941741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114941741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:44.864725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15700): Terminating (SIGTERM) 11:49:44.904640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15703): Terminating (SIGTERM) 11:49:44.944638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15706): Terminating (SIGTERM) 11:49:44.985081 --- ParallelTerminationStrategy: PID 15700 died... 11:49:45.004231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15700): Terminated: ok {rc=0} 11:49:45.049099 --- ParallelTerminationStrategy: PID 15703 died... 11:49:45.068036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15703): Terminated: ok {rc=0} 11:49:45.112433 --- ParallelTerminationStrategy: PID 15706 died... 11:49:45.131360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15706): Terminated: ok {rc=0} 11:49:45.218482 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:49:46.565377 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:49:46.572057 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:49:46.593481 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:49:46.632886 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:49:46.719737 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:49:46.741672 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:49:46.782551 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:49:47.390424 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:49:47.444326 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:47.455772 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:49:47.513390 tst cs_paging_gprs_active.py: using LAC 33741 11:49:47.641648 tst cs_paging_gprs_active.py: using RAC 81 11:49:47.771624 tst cs_paging_gprs_active.py: using CellId 33741 11:49:47.899594 tst cs_paging_gprs_active.py: using BVCI 33742 11:49:48.020718 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:48.032230 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:48.043401 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:48.054659 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:48.066049 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:48.077645 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:48.089259 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:48.100519 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:49:48.112116 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:49:48.233830 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:49:48.353097 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:49:48.563252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:48.877095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15711): Launched 11:49:49.150643 run iperf3-srv_10.42.42.10(pid=15712): Launched 11:49:49.269179 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:49:49.478129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:49.791990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15713): Launched 11:49:50.066952 run iperf3-srv_10.42.42.10(pid=15714): Launched 11:49:50.183149 tst cs_paging_gprs_active.py:38: start network... 11:49:50.391193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:50.873996 run create_hlr_db(pid=15715): Launched 11:49:51.002726 bus /gobi_6: Setting Powered False 11:49:52.064386 run create_hlr_db(pid=15715): Terminated: ok {rc=0} 11:49:52.519516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15717): Launched 11:49:52.853840 run osmo-hlr_10.42.42.2(pid=15718): Launched 11:49:52.983199 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:53.555960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15720): Launched 11:49:53.890397 run osmo-stp_10.42.42.5(pid=15721): Launched 11:49:54.018175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:54.592168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15723): Launched 11:49:54.720315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:55.002182 run patchelf(pid=15724): Launched 11:49:55.186368 run osmo-stp_10.42.42.5(pid=15721): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15721)] 11:49:55.326469 run osmo-stp_10.42.42.5(pid=15721): stdout: | (launched: 2022-12-13_11:49:53.828127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:55.468740 run osmo-stp_10.42.42.5(pid=15721): stderr: | 20221213114954024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114954024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114954024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114954025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114954025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114954025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114954025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:55.611465 run osmo-stp_10.42.42.5(pid=15721): stdout: | (launched: 2022-12-13_11:49:53.828127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:55.746799 run osmo-stp_10.42.42.5(pid=15721): stderr: | 20221213114954024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213114954024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213114954024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213114954025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213114954025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213114954025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213114954025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:55.907237 run patchelf(pid=15724): Terminating (SIGINT) 11:49:56.093562 run patchelf(pid=15724): Terminated: ok {rc=0} 11:49:56.227358 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15721): Process ended prematurely: osmo-stp_10.42.42.5(pid=15721) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15721)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:49:56.237933 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:49:56.266328 run osmo-hlr_10.42.42.2(pid=15718): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15718)] 11:49:56.317464 run osmo-hlr_10.42.42.2(pid=15718): stdout: | (launched: 2022-12-13_11:49:52.791637) 11:49:56.369909 run osmo-hlr_10.42.42.2(pid=15718): stderr: | 20221213114952995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213114952995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213114952995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213114952995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213114952995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213114952995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213114953008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213114953017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213114953017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213114953017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:56.422507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15711): Terminating (SIGTERM) 11:49:56.464806 run iperf3-srv_10.42.42.10(pid=15712): Terminating (SIGTERM) 11:49:56.507442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15713): Terminating (SIGTERM) 11:49:56.550289 run iperf3-srv_10.42.42.10(pid=15714): Terminating (SIGTERM) 11:49:56.592435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15717): Terminating (SIGTERM) 11:49:56.634641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15720): Terminating (SIGTERM) 11:49:56.676748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15723): Terminating (SIGTERM) 11:49:56.719110 --- ParallelTerminationStrategy: PID 15711 died... 11:49:56.739443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15711): Terminated: ok {rc=0} 11:49:56.785981 --- ParallelTerminationStrategy: PID 15712 died... 11:49:56.805915 run iperf3-srv_10.42.42.10(pid=15712): Terminated {rc=256} 11:49:56.852024 --- ParallelTerminationStrategy: PID 15713 died... 11:49:56.871686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15713): Terminated: ok {rc=0} 11:49:56.918126 --- ParallelTerminationStrategy: PID 15714 died... 11:49:56.937925 run iperf3-srv_10.42.42.10(pid=15714): Terminated {rc=256} 11:49:56.984373 --- ParallelTerminationStrategy: PID 15717 died... 11:49:57.004302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15717): Terminated: ok {rc=0} 11:49:57.050597 --- ParallelTerminationStrategy: PID 15720 died... 11:49:57.070486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15720): Terminated: ok {rc=0} 11:49:57.116842 --- ParallelTerminationStrategy: PID 15723 died... 11:49:57.137244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15723): Terminated: ok {rc=0} 11:49:57.226668 bus /gobi_0: Setting Powered False 11:49:58.325848 bus /gobi_0: Setting Powered False 11:49:59.444492 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:50:00.591095 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:00.602820 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:50:00.663631 tst iperf3.py: using LAC 33742 11:50:00.787188 tst iperf3.py: using RAC 82 11:50:00.925523 tst iperf3.py: using CellId 33742 11:50:01.061527 tst iperf3.py: using BVCI 33743 11:50:01.222165 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:01.233834 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:01.244750 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:01.256048 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:01.267832 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:01.279182 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:01.291204 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:01.303930 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:01.324576 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:50:01.469505 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:50:01.705963 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:02.024400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15728): Launched 11:50:02.313909 run iperf3-srv_10.42.42.10(pid=15729): Launched 11:50:02.444069 tst iperf3.py:8: start network... 11:50:02.652331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:03.135275 run create_hlr_db(pid=15730): Launched 11:50:03.263695 bus /gobi_6: Setting Powered False 11:50:04.325147 run create_hlr_db(pid=15730): Terminated: ok {rc=0} 11:50:04.759882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15733): Launched 11:50:05.073260 run osmo-hlr_10.42.42.2(pid=15734): Launched 11:50:05.190475 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:05.726547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15736): Launched 11:50:06.038878 run osmo-stp_10.42.42.5(pid=15737): Launched 11:50:06.160675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:06.696183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15739): Launched 11:50:06.816642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:07.080675 run patchelf(pid=15740): Launched 11:50:07.254334 run osmo-stp_10.42.42.5(pid=15737): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15737)] 11:50:07.385447 run osmo-stp_10.42.42.5(pid=15737): stdout: | (launched: 2022-12-13_11:50:05.980356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:07.518107 run osmo-stp_10.42.42.5(pid=15737): stderr: | 20221213115006157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115006157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115006157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115006157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115006158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115006158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115006158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:07.650997 run osmo-stp_10.42.42.5(pid=15737): stdout: | (launched: 2022-12-13_11:50:05.980356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:07.777587 run osmo-stp_10.42.42.5(pid=15737): stderr: | 20221213115006157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115006157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115006157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115006157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115006158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115006158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115006158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:07.927309 run patchelf(pid=15740): Terminating (SIGINT) 11:50:08.101780 run patchelf(pid=15740): Terminated: ok {rc=0} 11:50:08.227111 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15737): Process ended prematurely: osmo-stp_10.42.42.5(pid=15737) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15737)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 11:50:08.236732 tst iperf3.py:8: Test FAILED (7.7 sec) 11:50:08.263975 run osmo-hlr_10.42.42.2(pid=15734): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15734)] 11:50:08.311877 run osmo-hlr_10.42.42.2(pid=15734): stdout: | (launched: 2022-12-13_11:50:05.014628) 11:50:08.361586 run osmo-hlr_10.42.42.2(pid=15734): stderr: | 20221213115005196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115005196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115005196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115005196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115005196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115005196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115005208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115005217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115005217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115005217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:08.412016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15728): Terminating (SIGTERM) 11:50:08.452391 run iperf3-srv_10.42.42.10(pid=15729): Terminating (SIGTERM) 11:50:08.492442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15733): Terminating (SIGTERM) 11:50:08.532633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15736): Terminating (SIGTERM) 11:50:08.572748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15739): Terminating (SIGTERM) 11:50:08.612918 --- ParallelTerminationStrategy: PID 15728 died... 11:50:08.632134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15728): Terminated: ok {rc=0} 11:50:08.676215 --- ParallelTerminationStrategy: PID 15729 died... 11:50:08.694954 run iperf3-srv_10.42.42.10(pid=15729): Terminated {rc=256} 11:50:08.738770 --- ParallelTerminationStrategy: PID 15733 died... 11:50:08.757649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15733): Terminated: ok {rc=0} 11:50:08.801538 --- ParallelTerminationStrategy: PID 15736 died... 11:50:08.820251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15736): Terminated: ok {rc=0} 11:50:08.863998 --- ParallelTerminationStrategy: PID 15739 died... 11:50:08.882655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15739): Terminated: ok {rc=0} 11:50:08.969004 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:50:10.117968 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:10.130064 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:50:10.191421 tst iperf3m4.py: using LAC 33743 11:50:10.321328 tst iperf3m4.py: using RAC 83 11:50:10.449398 tst iperf3m4.py: using CellId 33743 11:50:10.576901 tst iperf3m4.py: using BVCI 33744 11:50:10.697698 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:10.709299 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:10.720466 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:10.731748 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:10.743205 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:10.754789 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:10.766564 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:10.778006 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:10.789684 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:50:10.908038 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:50:11.030754 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:50:11.150334 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:50:11.269200 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:50:11.478414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:11.792191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15741): Launched 11:50:12.064850 run iperf3-srv_10.42.42.10(pid=15742): Launched 11:50:12.181558 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:50:12.390590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:12.704071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15743): Launched 11:50:12.977865 run iperf3-srv_10.42.42.10(pid=15744): Launched 11:50:13.093534 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:50:13.301707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:13.614689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15745): Launched 11:50:13.887653 run iperf3-srv_10.42.42.10(pid=15746): Launched 11:50:14.004852 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:50:14.214059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:14.527935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15747): Launched 11:50:14.801451 run iperf3-srv_10.42.42.10(pid=15748): Launched 11:50:14.917609 tst iperf3m4.py:8: start network... 11:50:15.127688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:15.612053 run create_hlr_db(pid=15749): Launched 11:50:15.742436 bus /gobi_6: Setting Powered False 11:50:16.815989 run create_hlr_db(pid=15749): Terminated: ok {rc=0} 11:50:17.300388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15751): Launched 11:50:17.641585 run osmo-hlr_10.42.42.2(pid=15752): Launched 11:50:17.770897 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:18.349360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15754): Launched 11:50:18.684512 run osmo-stp_10.42.42.5(pid=15755): Launched 11:50:18.811692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:19.384284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15757): Launched 11:50:19.513089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:19.794217 run patchelf(pid=15758): Launched 11:50:19.980307 run osmo-stp_10.42.42.5(pid=15755): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15755)] 11:50:20.120752 run osmo-stp_10.42.42.5(pid=15755): stdout: | (launched: 2022-12-13_11:50:18.621994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:20.262966 run osmo-stp_10.42.42.5(pid=15755): stderr: | 20221213115018817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115018817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115018818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115018818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115018818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115018818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115018819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:20.404638 run osmo-stp_10.42.42.5(pid=15755): stdout: | (launched: 2022-12-13_11:50:18.621994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:20.539923 run osmo-stp_10.42.42.5(pid=15755): stderr: | 20221213115018817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115018817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115018818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115018818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115018818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115018818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115018819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:20.700563 run patchelf(pid=15758): Terminating (SIGINT) 11:50:20.885497 run patchelf(pid=15758): Terminated: ok {rc=0} 11:50:21.019423 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15755): Process ended prematurely: osmo-stp_10.42.42.5(pid=15755) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15755)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:50:21.029899 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:50:21.058907 run osmo-hlr_10.42.42.2(pid=15752): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15752)] 11:50:21.110318 run osmo-hlr_10.42.42.2(pid=15752): stdout: | (launched: 2022-12-13_11:50:17.579477) 11:50:21.163839 run osmo-hlr_10.42.42.2(pid=15752): stderr: | 20221213115017781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115017781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115017782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115017782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115017782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115017782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115017794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115017802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115017802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115017803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:21.216691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15741): Terminating (SIGTERM) 11:50:21.259852 run iperf3-srv_10.42.42.10(pid=15742): Terminating (SIGTERM) 11:50:21.302724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15743): Terminating (SIGTERM) 11:50:21.345386 run iperf3-srv_10.42.42.10(pid=15744): Terminating (SIGTERM) 11:50:21.388506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15745): Terminating (SIGTERM) 11:50:21.431278 run iperf3-srv_10.42.42.10(pid=15746): Terminating (SIGTERM) 11:50:21.473785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15747): Terminating (SIGTERM) 11:50:21.516883 run iperf3-srv_10.42.42.10(pid=15748): Terminating (SIGTERM) 11:50:21.559837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15751): Terminating (SIGTERM) 11:50:21.602540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15754): Terminating (SIGTERM) 11:50:21.645453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15757): Terminating (SIGTERM) 11:50:21.688306 --- ParallelTerminationStrategy: PID 15741 died... 11:50:21.708937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15741): Terminated: ok {rc=0} 11:50:21.756492 --- ParallelTerminationStrategy: PID 15742 died... 11:50:21.776705 run iperf3-srv_10.42.42.10(pid=15742): Terminated {rc=256} 11:50:21.823490 --- ParallelTerminationStrategy: PID 15743 died... 11:50:21.843698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15743): Terminated: ok {rc=0} 11:50:21.890866 --- ParallelTerminationStrategy: PID 15744 died... 11:50:21.910778 run iperf3-srv_10.42.42.10(pid=15744): Terminated {rc=256} 11:50:21.957375 --- ParallelTerminationStrategy: PID 15745 died... 11:50:21.977761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15745): Terminated: ok {rc=0} 11:50:22.024653 --- ParallelTerminationStrategy: PID 15746 died... 11:50:22.044760 run iperf3-srv_10.42.42.10(pid=15746): Terminated {rc=256} 11:50:22.091601 --- ParallelTerminationStrategy: PID 15747 died... 11:50:22.111681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15747): Terminated: ok {rc=0} 11:50:22.158675 --- ParallelTerminationStrategy: PID 15748 died... 11:50:22.178775 run iperf3-srv_10.42.42.10(pid=15748): Terminated {rc=256} 11:50:22.225726 --- ParallelTerminationStrategy: PID 15751 died... 11:50:22.245868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15751): Terminated: ok {rc=0} 11:50:22.292681 --- ParallelTerminationStrategy: PID 15754 died... 11:50:22.312825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15754): Terminated: ok {rc=0} 11:50:22.359660 --- ParallelTerminationStrategy: PID 15757 died... 11:50:22.379820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15757): Terminated: ok {rc=0} 11:50:22.470000 bus /gobi_4: Setting Powered False 11:50:23.570202 bus /gobi_4: Setting Powered False 11:50:24.687834 bus /gobi_1: Setting Powered False 11:50:25.786621 bus /gobi_1: Setting Powered False 11:50:26.906404 bus /gobi_0: Setting Powered False 11:50:28.005883 bus /gobi_0: Setting Powered False 11:50:29.121965 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:50:30.226886 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:30.238641 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:50:30.297445 tst ping.py: using LAC 33744 11:50:30.418551 tst ping.py: using RAC 84 11:50:30.539127 tst ping.py: using CellId 33744 11:50:30.660683 tst ping.py: using BVCI 33745 11:50:30.772138 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:30.783239 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:30.794011 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:30.804685 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:30.815441 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:30.826146 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:30.837541 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:30.848615 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:50:30.976179 tst ping.py:19: start network... 11:50:31.188166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:31.671028 run create_hlr_db(pid=15759): Launched 11:50:31.833880 bus /gobi_6: Setting Powered False 11:50:32.894537 run create_hlr_db(pid=15759): Terminated: ok {rc=0} 11:50:33.322409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15761): Launched 11:50:33.630762 run osmo-hlr_10.42.42.2(pid=15762): Launched 11:50:33.747090 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:34.294901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15764): Launched 11:50:34.602764 run osmo-stp_10.42.42.5(pid=15765): Launched 11:50:34.719509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:35.246098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15767): Launched 11:50:35.361897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:35.620467 run patchelf(pid=15768): Launched 11:50:35.791557 run osmo-stp_10.42.42.5(pid=15765): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15765)] 11:50:35.920213 run osmo-stp_10.42.42.5(pid=15765): stdout: | (launched: 2022-12-13_11:50:34.545094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:36.050971 run osmo-stp_10.42.42.5(pid=15765): stderr: | 20221213115034718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115034718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115034719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115034719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115034719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115034720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115034720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:36.181211 run osmo-stp_10.42.42.5(pid=15765): stdout: | (launched: 2022-12-13_11:50:34.545094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:36.306170 run osmo-stp_10.42.42.5(pid=15765): stderr: | 20221213115034718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115034718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115034719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115034719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115034719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115034720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115034720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:36.453871 run patchelf(pid=15768): Terminating (SIGINT) 11:50:36.622910 run patchelf(pid=15768): Terminated: ok {rc=0} 11:50:36.745070 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15765): Process ended prematurely: osmo-stp_10.42.42.5(pid=15765) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15765)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 11:50:36.754172 tst ping.py:22: Test FAILED (6.5 sec) 11:50:36.781129 run osmo-hlr_10.42.42.2(pid=15762): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15762)] 11:50:36.829178 run osmo-hlr_10.42.42.2(pid=15762): stdout: | (launched: 2022-12-13_11:50:33.572766) 11:50:36.879682 run osmo-hlr_10.42.42.2(pid=15762): stderr: | 20221213115033753 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115033753 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115033753 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115033753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115033753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115033753 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115033771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115033780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115033780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115033781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:36.930004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15761): Terminating (SIGTERM) 11:50:36.970355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15764): Terminating (SIGTERM) 11:50:37.010610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15767): Terminating (SIGTERM) 11:50:37.051740 --- ParallelTerminationStrategy: PID 15761 died... 11:50:37.071367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15761): Terminated: ok {rc=0} 11:50:37.115832 --- ParallelTerminationStrategy: PID 15764 died... 11:50:37.134738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15764): Terminated: ok {rc=0} 11:50:37.179089 --- ParallelTerminationStrategy: PID 15767 died... 11:50:37.198083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15767): Terminated: ok {rc=0} 11:50:37.282475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:50:38.368272 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:38.380250 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:50:38.439975 tst ping_idle_ping.py: using LAC 33745 11:50:38.572158 tst ping_idle_ping.py: using RAC 85 11:50:38.699395 tst ping_idle_ping.py: using CellId 33745 11:50:38.825427 tst ping_idle_ping.py: using BVCI 33746 11:50:38.938738 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:38.949975 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:38.960891 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:38.971868 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:38.983369 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:38.994825 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:39.006351 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:50:39.017708 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:50:39.138563 tst ping_idle_ping.py:24: start network... 11:50:39.359704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:39.872837 run create_hlr_db(pid=15769): Launched 11:50:39.998799 bus /gobi_6: Setting Powered False 11:50:41.063908 run create_hlr_db(pid=15769): Terminated: ok {rc=0} 11:50:41.501688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15771): Launched 11:50:41.808836 run osmo-hlr_10.42.42.2(pid=15772): Launched 11:50:41.966438 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:42.534167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15774): Launched 11:50:42.863552 run osmo-stp_10.42.42.5(pid=15775): Launched 11:50:42.990447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:43.556072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15777): Launched 11:50:43.682601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:43.959133 run patchelf(pid=15778): Launched 11:50:44.141665 run osmo-stp_10.42.42.5(pid=15775): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15775)] 11:50:44.280089 run osmo-stp_10.42.42.5(pid=15775): stdout: | (launched: 2022-12-13_11:50:42.802497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:44.420212 run osmo-stp_10.42.42.5(pid=15775): stderr: | 20221213115042995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115042995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115042996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115042996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115042997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115042997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115042997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:44.560249 run osmo-stp_10.42.42.5(pid=15775): stdout: | (launched: 2022-12-13_11:50:42.802497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:44.693963 run osmo-stp_10.42.42.5(pid=15775): stderr: | 20221213115042995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115042995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115042996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115042996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115042997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115042997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115042997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:44.852375 run patchelf(pid=15778): Terminating (SIGINT) 11:50:45.034795 run patchelf(pid=15778): Terminated: ok {rc=0} 11:50:45.166133 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15775): Process ended prematurely: osmo-stp_10.42.42.5(pid=15775) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15775)] [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:50:45.175795 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:50:45.203985 run osmo-hlr_10.42.42.2(pid=15772): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15772)] 11:50:45.255070 run osmo-hlr_10.42.42.2(pid=15772): stdout: | (launched: 2022-12-13_11:50:41.751046) 11:50:45.307505 run osmo-hlr_10.42.42.2(pid=15772): stderr: | 20221213115041966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115041966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115041966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115041966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115041966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115041966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115041978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115041986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115041986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115041986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:45.360544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15771): Terminating (SIGTERM) 11:50:45.402925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15774): Terminating (SIGTERM) 11:50:45.445574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15777): Terminating (SIGTERM) 11:50:45.488768 --- ParallelTerminationStrategy: PID 15771 died... 11:50:45.509520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15771): Terminated: ok {rc=0} 11:50:45.556385 --- ParallelTerminationStrategy: PID 15774 died... 11:50:45.576347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15774): Terminated: ok {rc=0} 11:50:45.622808 --- ParallelTerminationStrategy: PID 15777 died... 11:50:45.642657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15777): Terminated: ok {rc=0} 11:50:45.731216 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:50:47.043464 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:50:47.051038 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:50:47.073063 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:50:47.112204 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:50:47.167893 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:50:47.189805 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:50:47.226883 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:50:47.781843 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:50:47.787128 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:47.798512 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:50:47.859834 tst switch_tch_pdch.py: using LAC 33746 11:50:47.980396 tst switch_tch_pdch.py: using RAC 86 11:50:48.108271 tst switch_tch_pdch.py: using CellId 33746 11:50:48.233565 tst switch_tch_pdch.py: using BVCI 33747 11:50:48.351389 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:48.363191 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:48.374666 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:48.386208 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:48.397906 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:48.409917 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:48.422140 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:50:48.434001 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:50:48.552354 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:50:48.673411 tst switch_tch_pdch.py:51: start network... 11:50:48.893317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:49.399084 run create_hlr_db(pid=15782): Launched 11:50:49.524236 bus /gobi_6: Setting Powered False 11:50:50.584628 run create_hlr_db(pid=15782): Terminated: ok {rc=0} 11:50:51.041262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15784): Launched 11:50:51.369576 run osmo-hlr_10.42.42.2(pid=15785): Launched 11:50:51.495046 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:52.059903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15791): Launched 11:50:52.388674 run osmo-stp_10.42.42.5(pid=15792): Launched 11:50:52.513996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:53.079156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15794): Launched 11:50:53.204168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:53.480800 run patchelf(pid=15795): Launched 11:50:53.663248 run osmo-stp_10.42.42.5(pid=15792): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15792)] 11:50:53.801418 run osmo-stp_10.42.42.5(pid=15792): stdout: | (launched: 2022-12-13_11:50:52.327496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:53.941320 run osmo-stp_10.42.42.5(pid=15792): stderr: | 20221213115052523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115052523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115052523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115052524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115052524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115052524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115052524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:54.081645 run osmo-stp_10.42.42.5(pid=15792): stdout: | (launched: 2022-12-13_11:50:52.327496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:54.215307 run osmo-stp_10.42.42.5(pid=15792): stderr: | 20221213115052523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115052523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115052523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115052524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115052524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115052524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115052524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:54.373819 run patchelf(pid=15795): Terminating (SIGINT) 11:50:54.555467 run patchelf(pid=15795): Terminated: ok {rc=0} 11:50:54.686789 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15792): Process ended prematurely: osmo-stp_10.42.42.5(pid=15792) [trial-2389↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15792)] [trial-2389↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:50:54.696348 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 11:50:54.724752 run osmo-hlr_10.42.42.2(pid=15785): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15785)] 11:50:54.776092 run osmo-hlr_10.42.42.2(pid=15785): stdout: | (launched: 2022-12-13_11:50:51.308381) 11:50:54.829124 run osmo-hlr_10.42.42.2(pid=15785): stderr: | 20221213115051509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115051509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115051509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115051509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115051509 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115051509 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115051521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115051529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115051530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115051530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:54.881914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15784): Terminating (SIGTERM) 11:50:54.924520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15791): Terminating (SIGTERM) 11:50:54.967077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15794): Terminating (SIGTERM) 11:50:55.010154 --- ParallelTerminationStrategy: PID 15784 died... 11:50:55.030949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15784): Terminated: ok {rc=0} 11:50:55.077844 --- ParallelTerminationStrategy: PID 15791 died... 11:50:55.097856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15791): Terminated: ok {rc=0} 11:50:55.144510 --- ParallelTerminationStrategy: PID 15794 died... 11:50:55.164595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15794): Terminated: ok {rc=0} 11:50:55.254135 bus /gobi_0: Setting Powered False 11:50:56.354391 bus /gobi_0: Setting Powered False 11:50:57.470957 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:50:58.709052 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:50:58.714645 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:50:58.735433 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:50:58.770767 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:50:58.823790 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:50:58.844773 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:50:58.879570 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:50:59.434982 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:50:59.440258 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:50:59.451474 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:50:59.509753 tst switch_tch_pdch.py: using LAC 33747 11:50:59.640032 tst switch_tch_pdch.py: using RAC 87 11:50:59.767034 tst switch_tch_pdch.py: using CellId 33747 11:50:59.894715 tst switch_tch_pdch.py: using BVCI 33748 11:51:00.014785 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:51:00.026340 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:51:00.037755 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:51:00.049004 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:51:00.060427 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:51:00.071887 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:51:00.083572 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:51:00.095068 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:51:00.212940 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:51:00.334800 tst switch_tch_pdch.py:51: start network... 11:51:00.555429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:01.044030 run create_hlr_db(pid=15799): Launched 11:51:01.212291 bus /gobi_6: Setting Powered False 11:51:02.271867 run create_hlr_db(pid=15799): Terminated: ok {rc=0} 11:51:02.676180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15801): Launched 11:51:02.984724 run osmo-hlr_10.42.42.2(pid=15802): Launched 11:51:03.101898 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:03.620796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15804): Launched 11:51:03.927776 run osmo-stp_10.42.42.5(pid=15805): Launched 11:51:04.045709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:04.546044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15807): Launched 11:51:04.662739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:04.921382 run patchelf(pid=15808): Launched 11:51:05.091533 run osmo-stp_10.42.42.5(pid=15805): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15805)] 11:51:05.219853 run osmo-stp_10.42.42.5(pid=15805): stdout: | (launched: 2022-12-13_11:51:03.870117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:05.349875 run osmo-stp_10.42.42.5(pid=15805): stderr: | 20221213115104046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115104046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115104046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115104047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115104047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115104047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115104047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:05.479723 run osmo-stp_10.42.42.5(pid=15805): stdout: | (launched: 2022-12-13_11:51:03.870117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:05.603570 run osmo-stp_10.42.42.5(pid=15805): stderr: | 20221213115104046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115104046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115104046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115104047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115104047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115104047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115104047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:05.750411 run patchelf(pid=15808): Terminating (SIGINT) 11:51:05.919612 run patchelf(pid=15808): Terminated: ok {rc=0} 11:51:06.041460 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15805): Process ended prematurely: osmo-stp_10.42.42.5(pid=15805) [trial-2389↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15805)] [trial-2389↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:51:06.050515 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 11:51:06.077253 run osmo-hlr_10.42.42.2(pid=15802): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15802)] 11:51:06.125363 run osmo-hlr_10.42.42.2(pid=15802): stdout: | (launched: 2022-12-13_11:51:02.926929) 11:51:06.175098 run osmo-hlr_10.42.42.2(pid=15802): stderr: | 20221213115103104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115103104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115103105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115103105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115103105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115103105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115103117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115103127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115103127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115103127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:06.225855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15801): Terminating (SIGTERM) 11:51:06.266239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15804): Terminating (SIGTERM) 11:51:06.306448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15807): Terminating (SIGTERM) 11:51:06.346833 --- ParallelTerminationStrategy: PID 15801 died... 11:51:06.366059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15801): Terminated: ok {rc=0} 11:51:06.410387 --- ParallelTerminationStrategy: PID 15804 died... 11:51:06.429231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15804): Terminated: ok {rc=0} 11:51:06.473360 --- ParallelTerminationStrategy: PID 15807 died... 11:51:06.492119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15807): Terminated: ok {rc=0} 11:51:06.579431 bus /gobi_0: Setting Powered False 11:51:07.679661 bus /gobi_0: Setting Powered False 11:51:08.794828 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_sms:trx-b200 --------------------------------------------------------------------- 11:51:10.031722 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:10.035881 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 11:51:10.069572 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 11:51:10.077063 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 11:51:10.129129 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 11:51:10.162594 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 11:51:10.169495 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 11:51:10.710710 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 11:51:10.715953 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 11:51:10.726930 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 11:51:10.777017 tst mo_mt_sms.py: using LAC 33748 11:51:10.897841 tst mo_mt_sms.py: using RAC 88 11:51:11.020175 tst mo_mt_sms.py: using CellId 33748 11:51:11.141985 tst mo_mt_sms.py: using BVCI 33749 11:51:11.261419 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 11:51:11.378976 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 11:51:11.493779 tst mo_mt_sms.py:9: start nitb and bts... 11:51:11.700257 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:51:12.323707 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15813): Launched 11:51:12.633344 run osmo-nitb_10.42.42.2(pid=15814): Launched 11:51:12.803843 run osmo-nitb_10.42.42.2(pid=15814): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15814)] 11:51:12.940351 run osmo-nitb_10.42.42.2(pid=15814): stdout: | (launched: 2022-12-13_11:51:12.574288) 11:51:13.078508 run osmo-nitb_10.42.42.2(pid=15814): stderr: | (launched: 2022-12-13_11:51:12.620656) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:51:13.216514 run osmo-nitb_10.42.42.2(pid=15814): stdout: | (launched: 2022-12-13_11:51:12.574288) 11:51:13.348496 run osmo-nitb_10.42.42.2(pid=15814): stderr: | (launched: 2022-12-13_11:51:12.620656) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15814): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15814) [trial-2389↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15814)] 11:51:13.750097 tst osmo-nitb_10.42.42.2(pid=15814): stdout: | (launched: 2022-12-13_11:51:12.574288) 11:51:13.873595 tst osmo-nitb_10.42.42.2(pid=15814): stderr: | (launched: 2022-12-13_11:51:12.620656) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:51:14.018806 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15814): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15814) [trial-2389↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15814)] [trial-2389↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 11:51:14.027370 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 11:51:14.033911 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15813): Terminating (SIGTERM) 11:51:14.242682 --- ParallelTerminationStrategy: PID 15813 died... 11:51:14.264664 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15813): Terminated: ok {rc=0} 11:51:14.349364 bus /sierra_3: Setting Powered False 11:51:15.446357 bus /sierra_3: Setting Powered False 11:51:16.562780 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 sms:trx-b200 --------------------------------------------------------------------- 11:51:17.760716 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:17.764613 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 11:51:17.797849 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:51:17.826152 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 11:51:17.880394 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 11:51:17.914057 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:51:17.941653 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 11:51:18.484895 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 11:51:18.490128 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:18.500846 tst sms:trx-b200: Using 1 x bts (candidates: 1) 11:51:18.549047 tst mo_mt_sms.py: using LAC 33749 11:51:18.668845 tst mo_mt_sms.py: using RAC 89 11:51:18.788716 tst mo_mt_sms.py: using CellId 33749 11:51:18.908652 tst mo_mt_sms.py: using BVCI 33750 11:51:19.021149 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:19.031902 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:19.042456 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:19.052785 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:19.063265 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:19.074143 tst sms:trx-b200: Using 1 x modem (candidates: 2) 11:51:19.195387 tst sms:trx-b200: Using 1 x modem (candidates: 2) 11:51:19.312676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:19.788758 run create_hlr_db(pid=15818): Launched 11:51:19.913385 bus /sierra_2: Setting Powered False 11:51:20.974520 run create_hlr_db(pid=15818): Terminated: ok {rc=0} 11:51:21.403015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15820): Launched 11:51:21.710256 run osmo-hlr_10.42.42.2(pid=15821): Launched 11:51:21.825051 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:22.354846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15823): Launched 11:51:22.661269 run osmo-stp_10.42.42.5(pid=15824): Launched 11:51:22.778850 run osmo-msc_10.42.42.6: Starting osmo-msc 11:51:23.331657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15826): Launched 11:51:23.639133 run osmo-msc_10.42.42.6(pid=15827): Launched 11:51:23.810557 run osmo-stp_10.42.42.5(pid=15824): ERR: Terminated: ERROR {rc=1} [trial-2389↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15824)] 11:51:23.939114 run osmo-stp_10.42.42.5(pid=15824): stdout: | (launched: 2022-12-13_11:51:22.603360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:24.067286 run osmo-stp_10.42.42.5(pid=15824): stderr: | 20221213115122778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115122778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115122778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115122779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115122779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115122779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115122779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:24.193458 run osmo-stp_10.42.42.5(pid=15824): stdout: | (launched: 2022-12-13_11:51:22.603360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:24.313853 run osmo-stp_10.42.42.5(pid=15824): stderr: | 20221213115122778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115122778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115122778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115122779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115122779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115122779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115122779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:24.458234 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15824): Process ended prematurely: osmo-stp_10.42.42.5(pid=15824) [trial-2389↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15824)] [trial-2389↪sms:trx-b200↪mo_mt_sms.py:16] 11:51:24.466557 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 11:51:24.492547 run osmo-hlr_10.42.42.2(pid=15821): ERR: Terminated: ERROR {rc=237} [trial-2389↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15821)] 11:51:24.541161 run osmo-hlr_10.42.42.2(pid=15821): stdout: | (launched: 2022-12-13_11:51:21.652649) 11:51:24.590863 run osmo-hlr_10.42.42.2(pid=15821): stderr: | 20221213115121832 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115121832 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115121832 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115121832 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115121832 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115121832 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115121845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115121855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115121856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115121856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:24.660355 run osmo-msc_10.42.42.6(pid=15827): ERR: Terminated: ERROR {rc=2} [trial-2389↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15827)] 11:51:24.708873 run osmo-msc_10.42.42.6(pid=15827): stdout: | (launched: 2022-12-13_11:51:23.581328) 11:51:24.758553 run osmo-msc_10.42.42.6(pid=15827): stderr: | 20221213115123854 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115123854 DLGLOBAL DEBUG validating counter group 0x7f139353dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115123854 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115123854 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115123854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115123854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115123856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115123856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115123856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115123857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:51:24.808582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15820): Terminating (SIGTERM) 11:51:24.848752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15823): Terminating (SIGTERM) 11:51:24.888780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15826): Terminating (SIGTERM) 11:51:24.929205 --- ParallelTerminationStrategy: PID 15820 died... 11:51:24.948335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15820): Terminated: ok {rc=0} 11:51:24.992713 --- ParallelTerminationStrategy: PID 15823 died... 11:51:25.011362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15823): Terminated: ok {rc=0} 11:51:25.055546 --- ParallelTerminationStrategy: PID 15826 died... 11:51:25.074332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15826): Terminated: ok {rc=0} 11:51:25.158686 bus /sierra_3: Setting Powered False 11:51:26.258217 bus /sierra_3: Setting Powered False 11:51:27.374838 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-b200 --------------------------------------------------------------------- 11:51:28.610192 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:28.614509 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 11:51:28.648772 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 11:51:28.656923 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 11:51:28.693538 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 11:51:28.728201 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 11:51:28.735361 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 11:51:29.255240 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 11:51:29.260383 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 11:51:29.271764 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 11:51:29.321447 tst assert_extension.py: using LAC 33750 11:51:29.448889 tst assert_extension.py: using RAC 90 11:51:29.579239 tst assert_extension.py: using CellId 33750 11:51:29.698759 tst assert_extension.py: using BVCI 33751 11:51:29.808503 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 11:51:29.926194 tst assert_extension.py:10: start nitb and bts... 11:51:30.147468 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:51:30.811595 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15832): Launched 11:51:31.173644 run osmo-nitb_10.42.42.2(pid=15833): Launched 11:51:31.386052 run osmo-nitb_10.42.42.2(pid=15833): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15833)] 11:51:31.528089 run osmo-nitb_10.42.42.2(pid=15833): stdout: | (launched: 2022-12-13_11:51:31.110839) 11:51:31.672044 run osmo-nitb_10.42.42.2(pid=15833): stderr: | (launched: 2022-12-13_11:51:31.159669) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:51:31.816629 run osmo-nitb_10.42.42.2(pid=15833): stdout: | (launched: 2022-12-13_11:51:31.110839) 11:51:31.958684 run osmo-nitb_10.42.42.2(pid=15833): stderr: | (launched: 2022-12-13_11:51:31.159669) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15833): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15833) [trial-2389↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15833)] 11:51:32.329665 tst osmo-nitb_10.42.42.2(pid=15833): stdout: | (launched: 2022-12-13_11:51:31.110839) 11:51:32.457773 tst osmo-nitb_10.42.42.2(pid=15833): stderr: | (launched: 2022-12-13_11:51:31.159669) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:51:32.603330 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15833): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15833) [trial-2389↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15833)] [trial-2389↪nitb_ussd:trx-b200↪assert_extension.py:12] 11:51:32.611747 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:51:32.618249 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15832): Terminating (SIGTERM) 11:51:32.827841 --- ParallelTerminationStrategy: PID 15832 died... 11:51:32.848622 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15832): Terminated: ok {rc=0} 11:51:32.936191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 ussd:trx-b200 --------------------------------------------------------------------- 11:51:34.114922 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:34.118935 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 11:51:34.152255 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:51:34.180603 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 11:51:34.218469 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 11:51:34.252477 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:51:34.279726 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 11:51:34.806783 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 ussd:trx-b200 assert_extension.py ---------------------------------------------- 11:51:34.812043 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:34.822846 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 11:51:34.870893 tst assert_extension.py: using LAC 33751 11:51:34.990763 tst assert_extension.py: using RAC 91 11:51:35.110906 tst assert_extension.py: using CellId 33751 11:51:35.235024 tst assert_extension.py: using BVCI 33752 11:51:35.346405 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:35.357110 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:35.367597 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:35.378099 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:35.388545 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:51:35.398997 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 11:51:35.518533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:36.024689 run create_hlr_db(pid=15837): Launched 11:51:36.150449 bus /sierra_2: Setting Powered False 11:51:37.214847 run create_hlr_db(pid=15837): Terminated: ok {rc=0} 11:51:37.652547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15839): Launched 11:51:37.960293 run osmo-hlr_10.42.42.2(pid=15840): Launched 11:51:38.076430 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:38.622472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15842): Launched 11:51:38.931336 run osmo-stp_10.42.42.5(pid=15843): Launched 11:51:39.050096 run osmo-msc_10.42.42.6: Starting osmo-msc 11:51:39.602529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15845): Launched 11:51:39.909499 run osmo-msc_10.42.42.6(pid=15846): Launched 11:51:40.082148 run osmo-stp_10.42.42.5(pid=15843): ERR: Terminated: ERROR {rc=1} [trial-2389↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15843)] 11:51:40.211106 run osmo-stp_10.42.42.5(pid=15843): stdout: | (launched: 2022-12-13_11:51:38.872914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:40.340237 run osmo-stp_10.42.42.5(pid=15843): stderr: | 20221213115139047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115139047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115139047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115139048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115139048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115139048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115139048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:40.467312 run osmo-stp_10.42.42.5(pid=15843): stdout: | (launched: 2022-12-13_11:51:38.872914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:40.588193 run osmo-stp_10.42.42.5(pid=15843): stderr: | 20221213115139047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115139047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115139047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115139048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115139048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115139048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115139048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:40.733672 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15843): Process ended prematurely: osmo-stp_10.42.42.5(pid=15843) [trial-2389↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15843)] [trial-2389↪ussd:trx-b200↪assert_extension.py:17] 11:51:40.742545 tst assert_extension.py:17: Test FAILED (5.9 sec) 11:51:40.768708 run osmo-hlr_10.42.42.2(pid=15840): ERR: Terminated: ERROR {rc=237} [trial-2389↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15840)] 11:51:40.817158 run osmo-hlr_10.42.42.2(pid=15840): stdout: | (launched: 2022-12-13_11:51:37.902814) 11:51:40.867348 run osmo-hlr_10.42.42.2(pid=15840): stderr: | 20221213115138080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115138080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115138080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115138081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115138081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115138081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115138093 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115138102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115138102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115138102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:40.936639 run osmo-msc_10.42.42.6(pid=15846): ERR: Terminated: ERROR {rc=2} [trial-2389↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15846)] 11:51:40.984402 run osmo-msc_10.42.42.6(pid=15846): stdout: | (launched: 2022-12-13_11:51:39.851716) 11:51:41.033995 run osmo-msc_10.42.42.6(pid=15846): stderr: | 20221213115140128 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115140128 DLGLOBAL DEBUG validating counter group 0x7fd39da5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115140128 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115140129 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115140129 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115140129 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115140131 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115140131 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115140131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115140131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:51:41.083951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15839): Terminating (SIGTERM) 11:51:41.123926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15842): Terminating (SIGTERM) 11:51:41.163819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15845): Terminating (SIGTERM) 11:51:41.203881 --- ParallelTerminationStrategy: PID 15839 died... 11:51:41.223164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15839): Terminated: ok {rc=0} 11:51:41.267047 --- ParallelTerminationStrategy: PID 15842 died... 11:51:41.285702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15842): Terminated: ok {rc=0} 11:51:41.329284 --- ParallelTerminationStrategy: PID 15845 died... 11:51:41.347759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15845): Terminated: ok {rc=0} 11:51:41.434270 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:51:42.657075 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:42.664579 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:51:42.700321 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:51:42.728202 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:51:42.781479 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:51:42.815642 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:51:42.843500 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:51:43.397736 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:51:43.449792 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:43.461267 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:51:43.531676 tst mo_mt_call.py: using LAC 33752 11:51:43.653476 tst mo_mt_call.py: using RAC 92 11:51:43.776173 tst mo_mt_call.py: using CellId 33752 11:51:43.899507 tst mo_mt_call.py: using BVCI 33753 11:51:44.014301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:44.025796 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:44.037009 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:44.048254 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:44.059781 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:44.071139 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:51:44.193309 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:51:44.312460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:44.797236 run create_hlr_db(pid=15851): Launched 11:51:44.924727 bus /sierra_2: Setting Powered False 11:51:45.995466 run create_hlr_db(pid=15851): Terminated: ok {rc=0} 11:51:46.504515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15853): Launched 11:51:46.852651 run osmo-hlr_10.42.42.2(pid=15854): Launched 11:51:47.124893 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:47.712937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15856): Launched 11:51:48.048041 run osmo-stp_10.42.42.5(pid=15857): Launched 11:51:48.175965 run osmo-msc_10.42.42.6: Starting osmo-msc 11:51:48.778103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15859): Launched 11:51:49.113345 run osmo-msc_10.42.42.6(pid=15860): Launched 11:51:49.300016 run osmo-stp_10.42.42.5(pid=15857): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15857)] 11:51:49.440382 run osmo-stp_10.42.42.5(pid=15857): stdout: | (launched: 2022-12-13_11:51:47.985601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:49.581341 run osmo-stp_10.42.42.5(pid=15857): stderr: | 20221213115148180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115148180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115148181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115148181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115148181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115148182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115148182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:49.720258 run osmo-stp_10.42.42.5(pid=15857): stdout: | (launched: 2022-12-13_11:51:47.985601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:49.852828 run osmo-stp_10.42.42.5(pid=15857): stderr: | 20221213115148180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115148180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115148181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115148181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115148181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115148182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115148182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:50.011811 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15857): Process ended prematurely: osmo-stp_10.42.42.5(pid=15857) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15857)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:51:50.021879 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 11:51:50.050181 run osmo-hlr_10.42.42.2(pid=15854): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15854)] 11:51:50.102015 run osmo-hlr_10.42.42.2(pid=15854): stdout: | (launched: 2022-12-13_11:51:46.792883) 11:51:50.154915 run osmo-hlr_10.42.42.2(pid=15854): stderr: | 20221213115147052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115147052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115147052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115147052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115147052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115147052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115147066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115147078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115147078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115147079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:50.228689 run osmo-msc_10.42.42.6(pid=15860): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15860)] 11:51:50.279472 run osmo-msc_10.42.42.6(pid=15860): stdout: | (launched: 2022-12-13_11:51:49.051189) 11:51:50.332267 run osmo-msc_10.42.42.6(pid=15860): stderr: | 20221213115149378 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115149378 DLGLOBAL DEBUG validating counter group 0x7fd2366cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115149378 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115149378 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115149378 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115149379 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115149380 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115149381 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115149381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115149381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:51:50.385583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15853): Terminating (SIGTERM) 11:51:50.428294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15856): Terminating (SIGTERM) 11:51:50.470951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15859): Terminating (SIGTERM) 11:51:50.514295 --- ParallelTerminationStrategy: PID 15853 died... 11:51:50.535028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15853): Terminated: ok {rc=0} 11:51:50.582591 --- ParallelTerminationStrategy: PID 15856 died... 11:51:50.602988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15856): Terminated: ok {rc=0} 11:51:50.650418 --- ParallelTerminationStrategy: PID 15859 died... 11:51:50.670624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15859): Terminated: ok {rc=0} 11:51:50.761064 bus /sierra_3: Setting Powered False 11:51:51.860479 bus /sierra_3: Setting Powered False 11:51:52.978560 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:51:54.130516 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:54.143172 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:51:54.217798 tst mo_mt_call_osmux.py: using LAC 33753 11:51:54.348901 tst mo_mt_call_osmux.py: using RAC 93 11:51:54.473152 tst mo_mt_call_osmux.py: using CellId 33753 11:51:54.600501 tst mo_mt_call_osmux.py: using BVCI 33754 11:51:54.715199 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:54.726654 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:54.737873 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:54.749056 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:54.760781 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:51:54.772524 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:51:54.894778 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:51:55.012665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:55.495063 run create_hlr_db(pid=15862): Launched 11:51:55.622742 bus /sierra_2: Setting Powered False 11:51:56.684534 run create_hlr_db(pid=15862): Terminated: ok {rc=0} 11:51:57.139848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15864): Launched 11:51:57.473237 run osmo-hlr_10.42.42.2(pid=15865): Launched 11:51:57.600036 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:58.171700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15867): Launched 11:51:58.504786 run osmo-stp_10.42.42.5(pid=15868): Launched 11:51:58.633291 run osmo-msc_10.42.42.6: Starting osmo-msc 11:51:59.234497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15870): Launched 11:51:59.567650 run osmo-msc_10.42.42.6(pid=15871): Launched 11:51:59.753839 run osmo-stp_10.42.42.5(pid=15868): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15868)] 11:51:59.893875 run osmo-stp_10.42.42.5(pid=15868): stdout: | (launched: 2022-12-13_11:51:58.442850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:00.035323 run osmo-stp_10.42.42.5(pid=15868): stderr: | 20221213115158638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115158639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115158639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115158639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115158640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115158640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115158640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:00.174327 run osmo-stp_10.42.42.5(pid=15868): stdout: | (launched: 2022-12-13_11:51:58.442850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:00.306613 run osmo-stp_10.42.42.5(pid=15868): stderr: | 20221213115158638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115158639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115158639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115158639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115158640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115158640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115158640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:00.464545 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15868): Process ended prematurely: osmo-stp_10.42.42.5(pid=15868) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15868)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:52:00.474613 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:52:00.502777 run osmo-hlr_10.42.42.2(pid=15865): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15865)] 11:52:00.554709 run osmo-hlr_10.42.42.2(pid=15865): stdout: | (launched: 2022-12-13_11:51:57.411561) 11:52:00.607828 run osmo-hlr_10.42.42.2(pid=15865): stderr: | 20221213115157616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115157616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115157616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115157616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115157616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115157616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115157631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115157640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115157641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115157641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:00.681880 run osmo-msc_10.42.42.6(pid=15871): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15871)] 11:52:00.732325 run osmo-msc_10.42.42.6(pid=15871): stdout: | (launched: 2022-12-13_11:51:59.505650) 11:52:00.785542 run osmo-msc_10.42.42.6(pid=15871): stderr: | 20221213115159831 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115159831 DLGLOBAL DEBUG validating counter group 0x7fe100479c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115159831 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115159831 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115159831 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115159831 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115159833 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115159833 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115159834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115159834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:00.838330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15864): Terminating (SIGTERM) 11:52:00.887206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15867): Terminating (SIGTERM) 11:52:00.947472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15870): Terminating (SIGTERM) 11:52:00.999511 --- ParallelTerminationStrategy: PID 15864 died... 11:52:01.021113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15864): Terminated: ok {rc=0} 11:52:01.069929 --- ParallelTerminationStrategy: PID 15867 died... 11:52:01.091423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15867): Terminated: ok {rc=0} 11:52:01.140730 --- ParallelTerminationStrategy: PID 15870 died... 11:52:01.162652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15870): Terminated: ok {rc=0} 11:52:01.256239 bus /sierra_3: Setting Powered False 11:52:02.358424 bus /sierra_3: Setting Powered False 11:52:03.475622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:52:04.732166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:52:04.739265 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:52:04.773559 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:52:04.802876 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:52:04.856697 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:52:04.891408 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:52:04.920121 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:52:05.471115 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:52:05.526041 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:05.537669 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:52:05.610303 tst mo_mt_call.py: using LAC 33754 11:52:05.741200 tst mo_mt_call.py: using RAC 94 11:52:05.872020 tst mo_mt_call.py: using CellId 33754 11:52:06.001572 tst mo_mt_call.py: using BVCI 33755 11:52:06.124052 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:06.135871 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:06.147596 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:06.159279 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:06.171591 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:06.183570 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:52:06.301872 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:52:06.418751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:06.900334 run create_hlr_db(pid=15876): Launched 11:52:07.027198 bus /sierra_2: Setting Powered False 11:52:08.089210 run create_hlr_db(pid=15876): Terminated: ok {rc=0} 11:52:08.543474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15878): Launched 11:52:08.877194 run osmo-hlr_10.42.42.2(pid=15879): Launched 11:52:09.006067 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:09.579631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15881): Launched 11:52:09.913114 run osmo-stp_10.42.42.5(pid=15882): Launched 11:52:10.040450 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:10.640083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15884): Launched 11:52:10.973585 run osmo-msc_10.42.42.6(pid=15885): Launched 11:52:11.159667 run osmo-stp_10.42.42.5(pid=15882): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15882)] 11:52:11.299417 run osmo-stp_10.42.42.5(pid=15882): stdout: | (launched: 2022-12-13_11:52:09.851138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:11.439901 run osmo-stp_10.42.42.5(pid=15882): stderr: | 20221213115210048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115210048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115210048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115210048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115210049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115210049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115210049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:11.579905 run osmo-stp_10.42.42.5(pid=15882): stdout: | (launched: 2022-12-13_11:52:09.851138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:11.711672 run osmo-stp_10.42.42.5(pid=15882): stderr: | 20221213115210048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115210048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115210048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115210048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115210049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115210049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115210049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:11.869708 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15882): Process ended prematurely: osmo-stp_10.42.42.5(pid=15882) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15882)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:52:11.879605 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:52:11.907587 run osmo-hlr_10.42.42.2(pid=15879): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15879)] 11:52:11.958755 run osmo-hlr_10.42.42.2(pid=15879): stdout: | (launched: 2022-12-13_11:52:08.815420) 11:52:12.011160 run osmo-hlr_10.42.42.2(pid=15879): stderr: | 20221213115209018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115209018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115209018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115209018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115209018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115209018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115209029 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115209039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115209039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115209040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:12.084874 run osmo-msc_10.42.42.6(pid=15885): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15885)] 11:52:12.135208 run osmo-msc_10.42.42.6(pid=15885): stdout: | (launched: 2022-12-13_11:52:10.911583) 11:52:12.187325 run osmo-msc_10.42.42.6(pid=15885): stderr: | 20221213115211240 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115211240 DLGLOBAL DEBUG validating counter group 0x7fcbed4e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115211240 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115211240 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115211240 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115211240 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115211242 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115211242 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115211243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115211243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:12.239913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15878): Terminating (SIGTERM) 11:52:12.282247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15881): Terminating (SIGTERM) 11:52:12.325174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15884): Terminating (SIGTERM) 11:52:12.368283 --- ParallelTerminationStrategy: PID 15878 died... 11:52:12.388777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15878): Terminated: ok {rc=0} 11:52:12.435849 --- ParallelTerminationStrategy: PID 15881 died... 11:52:12.456119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15881): Terminated: ok {rc=0} 11:52:12.503525 --- ParallelTerminationStrategy: PID 15884 died... 11:52:12.523854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15884): Terminated: ok {rc=0} 11:52:12.613597 bus /sierra_3: Setting Powered False 11:52:13.712686 bus /sierra_3: Setting Powered False 11:52:14.830612 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:52:15.989895 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:16.002799 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:52:16.075948 tst mo_mt_call_osmux.py: using LAC 33755 11:52:16.241430 tst mo_mt_call_osmux.py: using RAC 95 11:52:16.381521 tst mo_mt_call_osmux.py: using CellId 33755 11:52:16.514024 tst mo_mt_call_osmux.py: using BVCI 33756 11:52:16.637379 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:16.650128 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:16.663127 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:16.675876 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:16.689835 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:52:16.703329 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:52:16.828338 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:52:16.951148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:17.478714 run create_hlr_db(pid=15887): Launched 11:52:17.605462 bus /sierra_2: Setting Powered False 11:52:18.671238 run create_hlr_db(pid=15887): Terminated: ok {rc=0} 11:52:19.117420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15889): Launched 11:52:19.432721 run osmo-hlr_10.42.42.2(pid=15890): Launched 11:52:19.553194 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:20.095078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15892): Launched 11:52:20.409403 run osmo-stp_10.42.42.5(pid=15893): Launched 11:52:20.528731 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:21.099996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15895): Launched 11:52:21.416044 run osmo-msc_10.42.42.6(pid=15896): Launched 11:52:21.592118 run osmo-stp_10.42.42.5(pid=15893): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15893)] 11:52:21.722825 run osmo-stp_10.42.42.5(pid=15893): stdout: | (launched: 2022-12-13_11:52:20.349911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:21.854511 run osmo-stp_10.42.42.5(pid=15893): stderr: | 20221213115220525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115220525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115220525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115220525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115220526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115220526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115220526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:21.984349 run osmo-stp_10.42.42.5(pid=15893): stdout: | (launched: 2022-12-13_11:52:20.349911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:22.108809 run osmo-stp_10.42.42.5(pid=15893): stderr: | 20221213115220525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115220525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115220525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115220525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115220526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115220526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115220526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:22.256684 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15893): Process ended prematurely: osmo-stp_10.42.42.5(pid=15893) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15893)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:52:22.265973 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:52:22.292512 run osmo-hlr_10.42.42.2(pid=15890): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15890)] 11:52:22.340545 run osmo-hlr_10.42.42.2(pid=15890): stdout: | (launched: 2022-12-13_11:52:19.373947) 11:52:22.390504 run osmo-hlr_10.42.42.2(pid=15890): stderr: | 20221213115219556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115219556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115219556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115219556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115219556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115219556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115219568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115219576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115219576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115219577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:22.459833 run osmo-msc_10.42.42.6(pid=15896): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15896)] 11:52:22.507541 run osmo-msc_10.42.42.6(pid=15896): stdout: | (launched: 2022-12-13_11:52:21.357301) 11:52:22.557152 run osmo-msc_10.42.42.6(pid=15896): stderr: | 20221213115221633 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115221633 DLGLOBAL DEBUG validating counter group 0x7f87e691cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115221633 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115221633 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115221633 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115221634 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115221635 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115221636 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115221636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115221636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:22.606974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15889): Terminating (SIGTERM) 11:52:22.646701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15892): Terminating (SIGTERM) 11:52:22.686211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15895): Terminating (SIGTERM) 11:52:22.726058 --- ParallelTerminationStrategy: PID 15889 died... 11:52:22.745482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15889): Terminated: ok {rc=0} 11:52:22.789964 --- ParallelTerminationStrategy: PID 15892 died... 11:52:22.808936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15892): Terminated: ok {rc=0} 11:52:22.852907 --- ParallelTerminationStrategy: PID 15895 died... 11:52:22.872036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15895): Terminated: ok {rc=0} 11:52:22.957921 bus /sierra_3: Setting Powered False 11:52:24.058378 bus /sierra_3: Setting Powered False 11:52:25.173268 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:52:26.431565 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:52:26.438855 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:52:26.473981 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:52:26.502316 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:52:26.556553 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:52:26.591382 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:52:26.619377 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:52:27.168080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:52:27.219642 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:27.230969 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:52:27.305672 tst mo_mt_call.py: using LAC 33756 11:52:27.427646 tst mo_mt_call.py: using RAC 96 11:52:27.548290 tst mo_mt_call.py: using CellId 33756 11:52:27.668326 tst mo_mt_call.py: using BVCI 33757 11:52:27.780699 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:27.792023 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:27.803044 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:27.814064 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:27.825250 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:27.836302 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:52:27.954393 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:52:28.076833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:28.592309 run create_hlr_db(pid=15901): Launched 11:52:28.720374 bus /sierra_2: Setting Powered False 11:52:29.786117 run create_hlr_db(pid=15901): Terminated: ok {rc=0} 11:52:30.231243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15903): Launched 11:52:30.545856 run osmo-hlr_10.42.42.2(pid=15904): Launched 11:52:30.665879 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:31.268015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15906): Launched 11:52:31.622394 run osmo-stp_10.42.42.5(pid=15907): Launched 11:52:31.976748 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:32.637448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15909): Launched 11:52:32.972318 run osmo-msc_10.42.42.6(pid=15910): Launched 11:52:33.159677 run osmo-stp_10.42.42.5(pid=15907): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15907)] 11:52:33.300493 run osmo-stp_10.42.42.5(pid=15907): stdout: | (launched: 2022-12-13_11:52:31.558142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:33.440635 run osmo-stp_10.42.42.5(pid=15907): stderr: | 20221213115231770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115231771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115231771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115231772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115231772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115231772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115231773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:33.579307 run osmo-stp_10.42.42.5(pid=15907): stdout: | (launched: 2022-12-13_11:52:31.558142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:33.711437 run osmo-stp_10.42.42.5(pid=15907): stderr: | 20221213115231770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115231771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115231771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115231772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115231772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115231772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115231773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:33.869577 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15907): Process ended prematurely: osmo-stp_10.42.42.5(pid=15907) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15907)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:52:33.879337 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 11:52:33.907304 run osmo-hlr_10.42.42.2(pid=15904): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15904)] 11:52:33.958755 run osmo-hlr_10.42.42.2(pid=15904): stdout: | (launched: 2022-12-13_11:52:30.487080) 11:52:34.011169 run osmo-hlr_10.42.42.2(pid=15904): stderr: | 20221213115230669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115230669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115230669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115230669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115230669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115230669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115230684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115230695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115230695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115230696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:34.084824 run osmo-msc_10.42.42.6(pid=15910): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15910)] 11:52:34.135143 run osmo-msc_10.42.42.6(pid=15910): stdout: | (launched: 2022-12-13_11:52:32.910449) 11:52:34.187447 run osmo-msc_10.42.42.6(pid=15910): stderr: | 20221213115233235 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115233235 DLGLOBAL DEBUG validating counter group 0x7f44c3329c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115233235 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115233236 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115233236 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115233236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115233238 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115233238 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115233238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115233238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:34.240374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15903): Terminating (SIGTERM) 11:52:34.282507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15906): Terminating (SIGTERM) 11:52:34.325459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15909): Terminating (SIGTERM) 11:52:34.368268 --- ParallelTerminationStrategy: PID 15903 died... 11:52:34.388847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15903): Terminated: ok {rc=0} 11:52:34.435666 --- ParallelTerminationStrategy: PID 15906 died... 11:52:34.455842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15906): Terminated: ok {rc=0} 11:52:34.503376 --- ParallelTerminationStrategy: PID 15909 died... 11:52:34.523623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15909): Terminated: ok {rc=0} 11:52:34.613462 bus /sierra_3: Setting Powered False 11:52:35.715283 bus /sierra_3: Setting Powered False 11:52:36.832354 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:52:37.984203 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:37.996827 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:52:38.074592 tst mo_mt_call_osmux.py: using LAC 33757 11:52:38.204382 tst mo_mt_call_osmux.py: using RAC 97 11:52:38.334539 tst mo_mt_call_osmux.py: using CellId 33757 11:52:38.458513 tst mo_mt_call_osmux.py: using BVCI 33758 11:52:38.573571 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:38.585155 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:38.596386 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:38.607638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:38.619151 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:52:38.630507 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:52:38.751837 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:52:38.871031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:39.356038 run create_hlr_db(pid=15912): Launched 11:52:39.483906 bus /sierra_2: Setting Powered False 11:52:40.546069 run create_hlr_db(pid=15912): Terminated: ok {rc=0} 11:52:41.000239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15914): Launched 11:52:41.334531 run osmo-hlr_10.42.42.2(pid=15915): Launched 11:52:41.462548 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:42.037147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15917): Launched 11:52:42.349790 run osmo-stp_10.42.42.5(pid=15918): Launched 11:52:42.467286 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:43.030034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15920): Launched 11:52:43.344219 run osmo-msc_10.42.42.6(pid=15921): Launched 11:52:43.518355 run osmo-stp_10.42.42.5(pid=15918): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15918)] 11:52:43.649502 run osmo-stp_10.42.42.5(pid=15918): stdout: | (launched: 2022-12-13_11:52:42.291274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:43.780768 run osmo-stp_10.42.42.5(pid=15918): stderr: | 20221213115242466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115242466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115242466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115242467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115242467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115242467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115242467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:43.910411 run osmo-stp_10.42.42.5(pid=15918): stdout: | (launched: 2022-12-13_11:52:42.291274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:44.034247 run osmo-stp_10.42.42.5(pid=15918): stderr: | 20221213115242466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115242466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115242466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115242467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115242467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115242467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115242467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:44.182601 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15918): Process ended prematurely: osmo-stp_10.42.42.5(pid=15918) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15918)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:52:44.191732 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:52:44.218343 run osmo-hlr_10.42.42.2(pid=15915): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15915)] 11:52:44.266549 run osmo-hlr_10.42.42.2(pid=15915): stdout: | (launched: 2022-12-13_11:52:41.272053) 11:52:44.316194 run osmo-hlr_10.42.42.2(pid=15915): stderr: | 20221213115241473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115241473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115241473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115241473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115241473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115241474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115241486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115241497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115241497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115241497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:44.385263 run osmo-msc_10.42.42.6(pid=15921): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15921)] 11:52:44.432692 run osmo-msc_10.42.42.6(pid=15921): stdout: | (launched: 2022-12-13_11:52:43.284840) 11:52:44.481970 run osmo-msc_10.42.42.6(pid=15921): stderr: | 20221213115243561 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115243562 DLGLOBAL DEBUG validating counter group 0x7f917612bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115243562 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115243562 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115243562 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115243562 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115243564 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115243564 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115243564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115243564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:44.531595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15914): Terminating (SIGTERM) 11:52:44.571368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15917): Terminating (SIGTERM) 11:52:44.611122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15920): Terminating (SIGTERM) 11:52:44.651051 --- ParallelTerminationStrategy: PID 15914 died... 11:52:44.670523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15914): Terminated: ok {rc=0} 11:52:44.715015 --- ParallelTerminationStrategy: PID 15917 died... 11:52:44.733938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15917): Terminated: ok {rc=0} 11:52:44.777967 --- ParallelTerminationStrategy: PID 15920 died... 11:52:44.796982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15920): Terminated: ok {rc=0} 11:52:44.884128 bus /sierra_3: Setting Powered False 11:52:45.993999 bus /sierra_3: Setting Powered False 11:52:47.128310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:52:48.391460 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:52:48.397954 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:52:48.431220 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:52:48.458356 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:52:48.511832 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:52:48.546606 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:52:48.573623 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:52:49.126147 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:52:49.180122 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:49.192029 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:52:49.263807 tst mo_mt_call.py: using LAC 33758 11:52:49.393363 tst mo_mt_call.py: using RAC 98 11:52:49.524124 tst mo_mt_call.py: using CellId 33758 11:52:49.657818 tst mo_mt_call.py: using BVCI 33759 11:52:49.779340 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:49.791040 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:49.802539 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:49.813974 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:49.825897 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:49.837755 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:52:49.956642 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:52:50.075170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:50.556550 run create_hlr_db(pid=15926): Launched 11:52:50.686199 bus /sierra_2: Setting Powered False 11:52:51.747784 run create_hlr_db(pid=15926): Terminated: ok {rc=0} 11:52:52.198467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15928): Launched 11:52:52.510561 run osmo-hlr_10.42.42.2(pid=15929): Launched 11:52:52.630422 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:53.186033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15931): Launched 11:52:53.500201 run osmo-stp_10.42.42.5(pid=15932): Launched 11:52:53.619893 run osmo-msc_10.42.42.6: Starting osmo-msc 11:52:54.185513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15934): Launched 11:52:54.499604 run osmo-msc_10.42.42.6(pid=15935): Launched 11:52:54.675408 run osmo-stp_10.42.42.5(pid=15932): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15932)] 11:52:54.806505 run osmo-stp_10.42.42.5(pid=15932): stdout: | (launched: 2022-12-13_11:52:53.441620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:54.937912 run osmo-stp_10.42.42.5(pid=15932): stderr: | 20221213115253617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115253617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115253617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115253618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115253618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115253618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115253618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:55.066905 run osmo-stp_10.42.42.5(pid=15932): stdout: | (launched: 2022-12-13_11:52:53.441620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:55.190662 run osmo-stp_10.42.42.5(pid=15932): stderr: | 20221213115253617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115253617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115253617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115253618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115253618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115253618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115253618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:55.338462 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15932): Process ended prematurely: osmo-stp_10.42.42.5(pid=15932) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15932)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:52:55.347665 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:52:55.374149 run osmo-hlr_10.42.42.2(pid=15929): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15929)] 11:52:55.422514 run osmo-hlr_10.42.42.2(pid=15929): stdout: | (launched: 2022-12-13_11:52:52.452004) 11:52:55.472041 run osmo-hlr_10.42.42.2(pid=15929): stderr: | 20221213115252633 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115252633 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115252633 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115252633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115252633 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115252633 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115252645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115252654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115252654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115252655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:55.540909 run osmo-msc_10.42.42.6(pid=15935): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15935)] 11:52:55.588273 run osmo-msc_10.42.42.6(pid=15935): stdout: | (launched: 2022-12-13_11:52:54.440545) 11:52:55.637797 run osmo-msc_10.42.42.6(pid=15935): stderr: | 20221213115254718 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115254718 DLGLOBAL DEBUG validating counter group 0x7f0b46e77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115254718 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115254718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115254719 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115254719 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115254720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115254721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115254721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115254721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:52:55.687591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15928): Terminating (SIGTERM) 11:52:55.727228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15931): Terminating (SIGTERM) 11:52:55.766879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15934): Terminating (SIGTERM) 11:52:55.806750 --- ParallelTerminationStrategy: PID 15928 died... 11:52:55.826126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15928): Terminated: ok {rc=0} 11:52:55.870104 --- ParallelTerminationStrategy: PID 15931 died... 11:52:55.888533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15931): Terminated: ok {rc=0} 11:52:55.932542 --- ParallelTerminationStrategy: PID 15934 died... 11:52:55.951270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15934): Terminated: ok {rc=0} 11:52:56.038904 bus /sierra_3: Setting Powered False 11:52:57.139995 bus /sierra_3: Setting Powered False 11:52:58.253769 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:52:59.404334 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:59.416803 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:52:59.489708 tst mo_mt_call_osmux.py: using LAC 33759 11:52:59.614407 tst mo_mt_call_osmux.py: using RAC 99 11:52:59.738600 tst mo_mt_call_osmux.py: using CellId 33759 11:52:59.862957 tst mo_mt_call_osmux.py: using BVCI 33760 11:52:59.977963 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:52:59.989403 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:53:00.000535 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:53:00.011497 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:53:00.022789 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:53:00.034072 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:53:00.156457 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:53:00.277548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:00.761615 run create_hlr_db(pid=15937): Launched 11:53:00.903738 bus /sierra_2: Setting Powered False 11:53:01.968859 run create_hlr_db(pid=15937): Terminated: ok {rc=0} 11:53:02.447126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15939): Launched 11:53:02.761497 run osmo-hlr_10.42.42.2(pid=15940): Launched 11:53:02.880126 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:03.418941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15942): Launched 11:53:03.733643 run osmo-stp_10.42.42.5(pid=15943): Launched 11:53:03.852063 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:04.418330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15945): Launched 11:53:04.731827 run osmo-msc_10.42.42.6(pid=15946): Launched 11:53:04.906173 run osmo-stp_10.42.42.5(pid=15943): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15943)] 11:53:05.036895 run osmo-stp_10.42.42.5(pid=15943): stdout: | (launched: 2022-12-13_11:53:03.674964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:05.167430 run osmo-stp_10.42.42.5(pid=15943): stderr: | 20221213115303850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115303850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115303851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115303851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115303851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115303852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115303852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:05.296832 run osmo-stp_10.42.42.5(pid=15943): stdout: | (launched: 2022-12-13_11:53:03.674964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:05.421107 run osmo-stp_10.42.42.5(pid=15943): stderr: | 20221213115303850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115303850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115303851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115303851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115303851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115303852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115303852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:05.570001 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15943): Process ended prematurely: osmo-stp_10.42.42.5(pid=15943) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15943)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:53:05.579179 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:53:05.605839 run osmo-hlr_10.42.42.2(pid=15940): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15940)] 11:53:05.654432 run osmo-hlr_10.42.42.2(pid=15940): stdout: | (launched: 2022-12-13_11:53:02.703061) 11:53:05.704534 run osmo-hlr_10.42.42.2(pid=15940): stderr: | 20221213115302882 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115302882 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115302882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115302882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115302882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115302883 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115302895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115302904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115302904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115302904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:05.775071 run osmo-msc_10.42.42.6(pid=15946): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15946)] 11:53:05.823750 run osmo-msc_10.42.42.6(pid=15946): stdout: | (launched: 2022-12-13_11:53:04.673071) 11:53:05.874083 run osmo-msc_10.42.42.6(pid=15946): stderr: | 20221213115304949 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115304949 DLGLOBAL DEBUG validating counter group 0x7fe5eb661c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115304950 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115304950 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115304950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115304950 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115304952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115304952 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115304952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115304952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:05.924600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15939): Terminating (SIGTERM) 11:53:05.965534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15942): Terminating (SIGTERM) 11:53:06.006422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15945): Terminating (SIGTERM) 11:53:06.047404 --- ParallelTerminationStrategy: PID 15939 died... 11:53:06.067112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15939): Terminated: ok {rc=0} 11:53:06.112136 --- ParallelTerminationStrategy: PID 15942 died... 11:53:06.131360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15942): Terminated: ok {rc=0} 11:53:06.175973 --- ParallelTerminationStrategy: PID 15945 died... 11:53:06.194979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15945): Terminated: ok {rc=0} 11:53:06.280353 bus /sierra_3: Setting Powered False 11:53:07.380304 bus /sierra_3: Setting Powered False 11:53:08.500748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:53:09.759604 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:09.766703 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:53:09.802047 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:53:09.830425 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:53:09.886158 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:53:09.921972 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:53:09.950666 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:53:10.500593 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:53:10.550832 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:10.562080 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:53:10.636735 tst mo_mt_call.py: using LAC 33760 11:53:10.758334 tst mo_mt_call.py: using RAC 100 11:53:10.878408 tst mo_mt_call.py: using CellId 33760 11:53:11.000545 tst mo_mt_call.py: using BVCI 33761 11:53:11.113179 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:11.124267 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:11.135257 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:11.146332 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:11.157419 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:11.168338 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:53:11.291170 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:53:11.409958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:11.894029 run create_hlr_db(pid=15951): Launched 11:53:12.021364 bus /sierra_2: Setting Powered False 11:53:13.083274 run create_hlr_db(pid=15951): Terminated: ok {rc=0} 11:53:13.537866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15953): Launched 11:53:13.872630 run osmo-hlr_10.42.42.2(pid=15954): Launched 11:53:14.000385 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:14.567978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15956): Launched 11:53:14.901282 run osmo-stp_10.42.42.5(pid=15957): Launched 11:53:15.029270 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:15.630050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15959): Launched 11:53:15.983301 run osmo-msc_10.42.42.6(pid=15960): Launched 11:53:16.263808 run osmo-stp_10.42.42.5(pid=15957): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15957)] 11:53:16.601243 run osmo-stp_10.42.42.5(pid=15957): stdout: | (launched: 2022-12-13_11:53:14.839602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:16.970118 run osmo-stp_10.42.42.5(pid=15957): stderr: | 20221213115315034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115315034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115315035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115315035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115315036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115315036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115315036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:17.143473 run osmo-stp_10.42.42.5(pid=15957): stdout: | (launched: 2022-12-13_11:53:14.839602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:17.271641 run osmo-stp_10.42.42.5(pid=15957): stderr: | 20221213115315034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115315034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115315035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115315035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115315036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115315036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115315036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:17.423802 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15957): Process ended prematurely: osmo-stp_10.42.42.5(pid=15957) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15957)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:53:17.433101 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 11:53:17.459706 run osmo-hlr_10.42.42.2(pid=15954): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15954)] 11:53:17.508123 run osmo-hlr_10.42.42.2(pid=15954): stdout: | (launched: 2022-12-13_11:53:13.810639) 11:53:17.558080 run osmo-hlr_10.42.42.2(pid=15954): stderr: | 20221213115314012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115314012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115314012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115314012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115314012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115314012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115314025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115314034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115314034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115314034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:17.628148 run osmo-msc_10.42.42.6(pid=15960): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15960)] 11:53:17.676191 run osmo-msc_10.42.42.6(pid=15960): stdout: | (launched: 2022-12-13_11:53:15.915715) 11:53:17.725939 run osmo-msc_10.42.42.6(pid=15960): stderr: | 20221213115316737 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115316737 DLGLOBAL DEBUG validating counter group 0x7f7952f23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115316737 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115316737 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115316737 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115316737 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115316739 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115316740 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115316740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115316740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:17.776052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15953): Terminating (SIGTERM) 11:53:17.816093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15956): Terminating (SIGTERM) 11:53:17.856111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15959): Terminating (SIGTERM) 11:53:17.896345 --- ParallelTerminationStrategy: PID 15953 died... 11:53:17.915292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15953): Terminated: ok {rc=0} 11:53:17.959699 --- ParallelTerminationStrategy: PID 15956 died... 11:53:17.978453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15956): Terminated: ok {rc=0} 11:53:18.022751 --- ParallelTerminationStrategy: PID 15959 died... 11:53:18.041584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15959): Terminated: ok {rc=0} 11:53:18.128935 bus /sierra_3: Setting Powered False 11:53:19.229054 bus /sierra_3: Setting Powered False 11:53:20.345099 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:53:21.500027 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:21.512449 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:53:21.585447 tst mo_mt_call_osmux.py: using LAC 33761 11:53:21.711636 tst mo_mt_call_osmux.py: using RAC 101 11:53:21.835218 tst mo_mt_call_osmux.py: using CellId 33761 11:53:21.957165 tst mo_mt_call_osmux.py: using BVCI 33762 11:53:22.071640 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:22.083056 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:22.094353 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:22.105413 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:22.116650 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:53:22.127832 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:53:22.245054 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:53:22.362318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:22.879168 run create_hlr_db(pid=15962): Launched 11:53:23.008260 bus /sierra_2: Setting Powered False 11:53:24.074152 run create_hlr_db(pid=15962): Terminated: ok {rc=0} 11:53:24.519495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15964): Launched 11:53:24.835580 run osmo-hlr_10.42.42.2(pid=15965): Launched 11:53:24.955431 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:25.491132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15967): Launched 11:53:25.806085 run osmo-stp_10.42.42.5(pid=15968): Launched 11:53:25.924626 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:26.503572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15970): Launched 11:53:26.817575 run osmo-msc_10.42.42.6(pid=15971): Launched 11:53:26.991037 run osmo-stp_10.42.42.5(pid=15968): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15968)] 11:53:27.122393 run osmo-stp_10.42.42.5(pid=15968): stdout: | (launched: 2022-12-13_11:53:25.747325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:27.254178 run osmo-stp_10.42.42.5(pid=15968): stderr: | 20221213115325922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115325922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115325922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115325923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115325923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115325923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115325923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:27.384501 run osmo-stp_10.42.42.5(pid=15968): stdout: | (launched: 2022-12-13_11:53:25.747325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:27.508600 run osmo-stp_10.42.42.5(pid=15968): stderr: | 20221213115325922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115325922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115325922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115325923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115325923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115325923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115325923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:27.657703 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15968): Process ended prematurely: osmo-stp_10.42.42.5(pid=15968) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15968)] [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:53:27.667105 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:53:27.693887 run osmo-hlr_10.42.42.2(pid=15965): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15965)] 11:53:27.741942 run osmo-hlr_10.42.42.2(pid=15965): stdout: | (launched: 2022-12-13_11:53:24.776625) 11:53:27.791558 run osmo-hlr_10.42.42.2(pid=15965): stderr: | 20221213115324956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115324956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115324956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115324956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115324956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115324957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115324969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115324977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115324977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115324977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:27.860496 run osmo-msc_10.42.42.6(pid=15971): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15971)] 11:53:27.908111 run osmo-msc_10.42.42.6(pid=15971): stdout: | (launched: 2022-12-13_11:53:26.758806) 11:53:27.957725 run osmo-msc_10.42.42.6(pid=15971): stderr: | 20221213115327034 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115327034 DLGLOBAL DEBUG validating counter group 0x7f9b4d8bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115327034 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115327034 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115327035 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115327035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115327036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115327037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115327037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115327037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:28.007567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15964): Terminating (SIGTERM) 11:53:28.047427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15967): Terminating (SIGTERM) 11:53:28.087462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15970): Terminating (SIGTERM) 11:53:28.127855 --- ParallelTerminationStrategy: PID 15964 died... 11:53:28.147497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15964): Terminated: ok {rc=0} 11:53:28.192006 --- ParallelTerminationStrategy: PID 15967 died... 11:53:28.211012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15967): Terminated: ok {rc=0} 11:53:28.255343 --- ParallelTerminationStrategy: PID 15970 died... 11:53:28.274343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15970): Terminated: ok {rc=0} 11:53:28.362474 bus /sierra_3: Setting Powered False 11:53:29.462552 bus /sierra_3: Setting Powered False 11:53:30.577455 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:53:31.843991 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:31.850639 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:53:31.885781 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:53:31.913698 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:53:31.966181 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:53:32.001193 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:53:32.029143 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:53:32.585757 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:53:32.636360 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:32.647968 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:53:32.717511 tst mo_mt_call.py: using LAC 33762 11:53:32.838195 tst mo_mt_call.py: using RAC 102 11:53:32.960808 tst mo_mt_call.py: using CellId 33762 11:53:33.082033 tst mo_mt_call.py: using BVCI 33763 11:53:33.194414 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:33.205872 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:33.217081 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:33.228216 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:33.239347 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:33.250467 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:33.365150 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:33.486904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:34.003591 run create_hlr_db(pid=15976): Launched 11:53:34.130870 bus /sierra_2: Setting Powered False 11:53:35.193118 run create_hlr_db(pid=15976): Terminated: ok {rc=0} 11:53:35.655764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15978): Launched 11:53:35.988859 run osmo-hlr_10.42.42.2(pid=15979): Launched 11:53:36.118025 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:36.688731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15981): Launched 11:53:37.022617 run osmo-stp_10.42.42.5(pid=15982): Launched 11:53:37.151475 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:37.751734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15984): Launched 11:53:38.086483 run osmo-msc_10.42.42.6(pid=15985): Launched 11:53:38.270830 run osmo-stp_10.42.42.5(pid=15982): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15982)] 11:53:38.410683 run osmo-stp_10.42.42.5(pid=15982): stdout: | (launched: 2022-12-13_11:53:36.960493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:38.550846 run osmo-stp_10.42.42.5(pid=15982): stderr: | 20221213115337156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115337156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115337156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115337157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115337159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115337159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115337159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:38.689200 run osmo-stp_10.42.42.5(pid=15982): stdout: | (launched: 2022-12-13_11:53:36.960493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:38.821206 run osmo-stp_10.42.42.5(pid=15982): stderr: | 20221213115337156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115337156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115337156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115337157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115337159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115337159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115337159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:38.979201 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15982): Process ended prematurely: osmo-stp_10.42.42.5(pid=15982) [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15982)] [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:53:38.989101 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:53:39.017172 run osmo-hlr_10.42.42.2(pid=15979): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15979)] 11:53:39.068836 run osmo-hlr_10.42.42.2(pid=15979): stdout: | (launched: 2022-12-13_11:53:35.927117) 11:53:39.121315 run osmo-hlr_10.42.42.2(pid=15979): stderr: | 20221213115336128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115336128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115336128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115336128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115336128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115336128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115336143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115336153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115336153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115336153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:39.194299 run osmo-msc_10.42.42.6(pid=15985): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15985)] 11:53:39.244358 run osmo-msc_10.42.42.6(pid=15985): stdout: | (launched: 2022-12-13_11:53:38.023957) 11:53:39.297101 run osmo-msc_10.42.42.6(pid=15985): stderr: | 20221213115338351 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115338352 DLGLOBAL DEBUG validating counter group 0x7efdfd19cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115338352 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115338352 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115338352 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115338352 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115338354 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115338354 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115338355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115338355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:39.350009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15978): Terminating (SIGTERM) 11:53:39.392076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15981): Terminating (SIGTERM) 11:53:39.434689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15984): Terminating (SIGTERM) 11:53:39.477270 --- ParallelTerminationStrategy: PID 15978 died... 11:53:39.497862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15978): Terminated: ok {rc=0} 11:53:39.544485 --- ParallelTerminationStrategy: PID 15981 died... 11:53:39.564454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15981): Terminated: ok {rc=0} 11:53:39.610963 --- ParallelTerminationStrategy: PID 15984 died... 11:53:39.631153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15984): Terminated: ok {rc=0} 11:53:39.720507 bus /sierra_3: Setting Powered False 11:53:40.820172 bus /sierra_3: Setting Powered False 11:53:41.940534 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:53:43.089435 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:43.101658 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:53:43.172861 tst mo_mt_call_osmux.py: using LAC 33763 11:53:43.298010 tst mo_mt_call_osmux.py: using RAC 103 11:53:43.421839 tst mo_mt_call_osmux.py: using CellId 33763 11:53:43.543317 tst mo_mt_call_osmux.py: using BVCI 33764 11:53:43.657234 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:43.668520 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:43.679638 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:43.690701 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:43.701828 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:53:43.712934 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:43.836329 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:43.953984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:44.438853 run create_hlr_db(pid=15987): Launched 11:53:44.567600 bus /sierra_2: Setting Powered False 11:53:45.629456 run create_hlr_db(pid=15987): Terminated: ok {rc=0} 11:53:46.102742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15989): Launched 11:53:46.459118 run osmo-hlr_10.42.42.2(pid=15990): Launched 11:53:46.686809 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:47.497676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16028): Launched 11:53:47.926736 run osmo-stp_10.42.42.5(pid=16042): Launched 11:53:48.202427 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:49.020730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16158): Launched 11:53:49.429969 run osmo-msc_10.42.42.6(pid=16209): Launched 11:53:49.858509 run osmo-stp_10.42.42.5(pid=16042): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16042)] 11:53:50.101797 run osmo-stp_10.42.42.5(pid=16042): stdout: | (launched: 2022-12-13_11:53:47.856865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:50.316821 run osmo-stp_10.42.42.5(pid=16042): stderr: | 20221213115348210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115348210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115348210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115348211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115348222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115348222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115348222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:50.460263 run osmo-stp_10.42.42.5(pid=16042): stdout: | (launched: 2022-12-13_11:53:47.856865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:50.599189 run osmo-stp_10.42.42.5(pid=16042): stderr: | 20221213115348210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115348210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115348210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115348211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115348222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115348222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115348222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:50.764591 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16042): Process ended prematurely: osmo-stp_10.42.42.5(pid=16042) [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16042)] [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:53:50.776028 tst mo_mt_call_osmux.py:8: Test FAILED (7.7 sec) 11:53:50.805823 run osmo-hlr_10.42.42.2(pid=15990): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15990)] 11:53:50.862103 run osmo-hlr_10.42.42.2(pid=15990): stdout: | (launched: 2022-12-13_11:53:46.394915) 11:53:50.917327 run osmo-hlr_10.42.42.2(pid=15990): stderr: | 20221213115346735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115346735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115346735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115346736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115346736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115346736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115346755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115346763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115346764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115346764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:50.994693 run osmo-msc_10.42.42.6(pid=16209): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16209)] 11:53:51.047068 run osmo-msc_10.42.42.6(pid=16209): stdout: | (launched: 2022-12-13_11:53:49.351750) 11:53:51.104769 run osmo-msc_10.42.42.6(pid=16209): stderr: | 20221213115349861 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115349861 DLGLOBAL DEBUG validating counter group 0x7f9c6b7ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115349861 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115349861 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115349861 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115349862 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115349863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115349864 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115349864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115349864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:51.161741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15989): Terminating (SIGTERM) 11:53:51.205786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16028): Terminating (SIGTERM) 11:53:51.253672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16158): Terminating (SIGTERM) 11:53:51.300669 --- ParallelTerminationStrategy: PID 15989 died... 11:53:51.323571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15989): Terminated: ok {rc=0} 11:53:51.376751 --- ParallelTerminationStrategy: PID 16028 died... 11:53:51.397742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16028): Terminated: ok {rc=0} 11:53:51.446835 --- ParallelTerminationStrategy: PID 16158 died... 11:53:51.468735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16158): Terminated: ok {rc=0} 11:53:51.564001 bus /sierra_3: Setting Powered False 11:53:52.668594 bus /sierra_3: Setting Powered False 11:53:53.790354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:53:55.050621 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:55.057107 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:53:55.092539 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:53:55.121370 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:53:55.175283 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:53:55.211372 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:53:55.240568 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:53:55.787630 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:53:55.840898 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:55.853066 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:53:55.929748 tst mo_mt_call.py: using LAC 33764 11:53:56.058902 tst mo_mt_call.py: using RAC 104 11:53:56.184363 tst mo_mt_call.py: using CellId 33764 11:53:56.309668 tst mo_mt_call.py: using BVCI 33765 11:53:56.427940 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:56.440277 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:56.452272 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:56.464246 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:56.476638 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:53:56.489209 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:53:56.614940 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:53:56.737679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:57.236521 run create_hlr_db(pid=16272): Launched 11:53:57.404354 bus /sierra_2: Setting Powered False 11:53:58.468259 run create_hlr_db(pid=16272): Terminated: ok {rc=0} 11:53:58.922530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16274): Launched 11:53:59.260379 run osmo-hlr_10.42.42.2(pid=16275): Launched 11:53:59.505995 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:00.248447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16277): Launched 11:54:00.584084 run osmo-stp_10.42.42.5(pid=16278): Launched 11:54:00.830278 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:01.735653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16280): Launched 11:54:02.103131 run osmo-msc_10.42.42.6(pid=16281): Launched 11:54:02.498719 run osmo-stp_10.42.42.5(pid=16278): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16278)] 11:54:02.800154 run osmo-stp_10.42.42.5(pid=16278): stdout: | (launched: 2022-12-13_11:54:00.522371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:02.951207 run osmo-stp_10.42.42.5(pid=16278): stderr: | 20221213115400859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115400859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115400859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115400860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115400860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115400860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115400860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:03.093932 run osmo-stp_10.42.42.5(pid=16278): stdout: | (launched: 2022-12-13_11:54:00.522371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:03.230731 run osmo-stp_10.42.42.5(pid=16278): stderr: | 20221213115400859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115400859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115400859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115400860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115400860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115400860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115400860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:03.393736 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16278): Process ended prematurely: osmo-stp_10.42.42.5(pid=16278) [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16278)] [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:54:03.403618 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 11:54:03.432278 run osmo-hlr_10.42.42.2(pid=16275): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16275)] 11:54:03.487324 run osmo-hlr_10.42.42.2(pid=16275): stdout: | (launched: 2022-12-13_11:53:59.198847) 11:54:03.542087 run osmo-hlr_10.42.42.2(pid=16275): stderr: | 20221213115359546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115359546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115359546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115359546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115359546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115359546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115359563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115359579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115359580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115359580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:03.619977 run osmo-msc_10.42.42.6(pid=16281): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16281)] 11:54:03.673772 run osmo-msc_10.42.42.6(pid=16281): stdout: | (launched: 2022-12-13_11:54:02.039730) 11:54:03.728910 run osmo-msc_10.42.42.6(pid=16281): stderr: | 20221213115402509 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115402509 DLGLOBAL DEBUG validating counter group 0x7f7248f8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115402509 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115402509 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115402510 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115402510 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115402511 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115402512 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115402512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115402512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:03.786089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16274): Terminating (SIGTERM) 11:54:03.830500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16277): Terminating (SIGTERM) 11:54:03.878070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16280): Terminating (SIGTERM) 11:54:03.925722 --- ParallelTerminationStrategy: PID 16274 died... 11:54:03.947947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16274): Terminated: ok {rc=0} 11:54:04.002009 --- ParallelTerminationStrategy: PID 16277 died... 11:54:04.023075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16277): Terminated: ok {rc=0} 11:54:04.072770 --- ParallelTerminationStrategy: PID 16280 died... 11:54:04.095110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16280): Terminated: ok {rc=0} 11:54:04.191776 bus /sierra_3: Setting Powered False 11:54:05.298627 bus /sierra_3: Setting Powered False 11:54:06.423873 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:54:07.585721 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:54:07.599560 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:54:07.677439 tst mo_mt_call_osmux.py: using LAC 33765 11:54:07.812495 tst mo_mt_call_osmux.py: using RAC 105 11:54:07.950279 tst mo_mt_call_osmux.py: using CellId 33765 11:54:08.086174 tst mo_mt_call_osmux.py: using BVCI 33766 11:54:08.212477 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:54:08.225526 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:54:08.238187 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:54:08.250804 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:54:08.264703 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:54:08.278144 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:54:08.408017 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:54:08.537128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:09.074789 run create_hlr_db(pid=16283): Launched 11:54:09.245654 bus /sierra_2: Setting Powered False 11:54:10.315440 run create_hlr_db(pid=16283): Terminated: ok {rc=0} 11:54:10.804250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16285): Launched 11:54:11.118510 run osmo-hlr_10.42.42.2(pid=16287): Launched 11:54:11.238191 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:11.791121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16289): Launched 11:54:12.107210 run osmo-stp_10.42.42.5(pid=16290): Launched 11:54:12.227898 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:12.792044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16292): Launched 11:54:13.107501 run osmo-msc_10.42.42.6(pid=16293): Launched 11:54:13.282884 run osmo-stp_10.42.42.5(pid=16290): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16290)] 11:54:13.413398 run osmo-stp_10.42.42.5(pid=16290): stdout: | (launched: 2022-12-13_11:54:12.048213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:13.544167 run osmo-stp_10.42.42.5(pid=16290): stderr: | 20221213115412223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115412223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115412223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115412224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115412224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115412224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115412224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:13.674089 run osmo-stp_10.42.42.5(pid=16290): stdout: | (launched: 2022-12-13_11:54:12.048213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:13.797917 run osmo-stp_10.42.42.5(pid=16290): stderr: | 20221213115412223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115412223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115412223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115412224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115412224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115412224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115412224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:13.946437 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16290): Process ended prematurely: osmo-stp_10.42.42.5(pid=16290) [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16290)] [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:54:13.955640 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:54:13.982478 run osmo-hlr_10.42.42.2(pid=16287): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16287)] 11:54:14.031223 run osmo-hlr_10.42.42.2(pid=16287): stdout: | (launched: 2022-12-13_11:54:11.059612) 11:54:14.081617 run osmo-hlr_10.42.42.2(pid=16287): stderr: | 20221213115411239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115411239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115411239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115411239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115411239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115411239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115411252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115411260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115411261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115411261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:14.151458 run osmo-msc_10.42.42.6(pid=16293): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16293)] 11:54:14.199645 run osmo-msc_10.42.42.6(pid=16293): stdout: | (launched: 2022-12-13_11:54:13.048264) 11:54:14.249326 run osmo-msc_10.42.42.6(pid=16293): stderr: | 20221213115413324 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115413325 DLGLOBAL DEBUG validating counter group 0x7f2f5e164c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115413325 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115413325 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115413325 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115413325 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115413327 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115413327 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115413327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115413328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:14.299365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16285): Terminating (SIGTERM) 11:54:14.339505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16289): Terminating (SIGTERM) 11:54:14.379783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16292): Terminating (SIGTERM) 11:54:14.420231 --- ParallelTerminationStrategy: PID 16285 died... 11:54:14.439967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16285): Terminated: ok {rc=0} 11:54:14.484691 --- ParallelTerminationStrategy: PID 16289 died... 11:54:14.503899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16289): Terminated: ok {rc=0} 11:54:14.548412 --- ParallelTerminationStrategy: PID 16292 died... 11:54:14.567578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16292): Terminated: ok {rc=0} 11:54:14.652621 bus /sierra_3: Setting Powered False 11:54:15.751605 bus /sierra_3: Setting Powered False 11:54:16.869380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 11:54:18.123071 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:18.127888 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 11:54:18.161249 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 11:54:18.188313 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 11:54:18.244756 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 11:54:18.277904 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 11:54:18.304353 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 11:54:18.853937 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 11:54:18.903159 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:18.914285 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 11:54:18.968481 tst mo_mt_call.py: using LAC 33766 11:54:19.098129 tst mo_mt_call.py: using RAC 106 11:54:19.229170 tst mo_mt_call.py: using CellId 33766 11:54:19.357379 tst mo_mt_call.py: using BVCI 33767 11:54:19.478248 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:19.490136 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:19.501775 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:19.513340 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:19.525093 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:19.536764 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:54:19.655737 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:54:19.778240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:20.296423 run create_hlr_db(pid=16298): Launched 11:54:20.423962 bus /sierra_2: Setting Powered False 11:54:21.489701 run create_hlr_db(pid=16298): Terminated: ok {rc=0} 11:54:21.936767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16300): Launched 11:54:22.252610 run osmo-hlr_10.42.42.2(pid=16301): Launched 11:54:22.371339 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:22.922070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16303): Launched 11:54:23.234551 run osmo-stp_10.42.42.5(pid=16304): Launched 11:54:23.354671 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:23.917619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16306): Launched 11:54:24.230258 run osmo-msc_10.42.42.6(pid=16307): Launched 11:54:24.405333 run osmo-stp_10.42.42.5(pid=16304): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16304)] 11:54:24.537550 run osmo-stp_10.42.42.5(pid=16304): stdout: | (launched: 2022-12-13_11:54:23.175858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:24.668543 run osmo-stp_10.42.42.5(pid=16304): stderr: | 20221213115423350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115423350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115423350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115423351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115423351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115423351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115423351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:24.797598 run osmo-stp_10.42.42.5(pid=16304): stdout: | (launched: 2022-12-13_11:54:23.175858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:24.920516 run osmo-stp_10.42.42.5(pid=16304): stderr: | 20221213115423350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115423350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115423350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115423351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115423351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115423351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115423351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:25.068218 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16304): Process ended prematurely: osmo-stp_10.42.42.5(pid=16304) [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16304)] [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 11:54:25.077295 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:54:25.103608 run osmo-hlr_10.42.42.2(pid=16301): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16301)] 11:54:25.151652 run osmo-hlr_10.42.42.2(pid=16301): stdout: | (launched: 2022-12-13_11:54:22.194301) 11:54:25.201123 run osmo-hlr_10.42.42.2(pid=16301): stderr: | 20221213115422374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115422374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115422374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115422374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115422374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115422374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115422386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115422397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115422397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115422397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:25.269835 run osmo-msc_10.42.42.6(pid=16307): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16307)] 11:54:25.317589 run osmo-msc_10.42.42.6(pid=16307): stdout: | (launched: 2022-12-13_11:54:24.171437) 11:54:25.366868 run osmo-msc_10.42.42.6(pid=16307): stderr: | 20221213115424447 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115424448 DLGLOBAL DEBUG validating counter group 0x7fc52e0bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115424448 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115424448 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115424448 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115424448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115424450 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115424450 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115424451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115424451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:25.416359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16300): Terminating (SIGTERM) 11:54:25.455895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16303): Terminating (SIGTERM) 11:54:25.495703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16306): Terminating (SIGTERM) 11:54:25.535874 --- ParallelTerminationStrategy: PID 16300 died... 11:54:25.555072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16300): Terminated: ok {rc=0} 11:54:25.599301 --- ParallelTerminationStrategy: PID 16303 died... 11:54:25.617893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16303): Terminated: ok {rc=0} 11:54:25.661807 --- ParallelTerminationStrategy: PID 16306 died... 11:54:25.680369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16306): Terminated: ok {rc=0} 11:54:25.768488 bus /sierra_3: Setting Powered False 11:54:26.869273 bus /sierra_3: Setting Powered False 11:54:27.984503 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 11:54:29.132205 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:29.144160 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 11:54:29.195635 tst mo_mt_call_osmux.py: using LAC 33767 11:54:29.319961 tst mo_mt_call_osmux.py: using RAC 107 11:54:29.444042 tst mo_mt_call_osmux.py: using CellId 33767 11:54:29.567679 tst mo_mt_call_osmux.py: using BVCI 33768 11:54:29.682240 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:29.693413 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:29.704283 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:29.715243 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:29.726194 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:54:29.737083 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:54:29.854097 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:54:29.976341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:30.495342 run create_hlr_db(pid=16309): Launched 11:54:30.623452 bus /sierra_2: Setting Powered False 11:54:31.711025 run create_hlr_db(pid=16309): Terminated: ok {rc=0} 11:54:32.221658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16311): Launched 11:54:32.541485 run osmo-hlr_10.42.42.2(pid=16312): Launched 11:54:32.660320 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:33.211697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16314): Launched 11:54:33.526271 run osmo-stp_10.42.42.5(pid=16315): Launched 11:54:33.646302 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:34.209457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16317): Launched 11:54:34.524929 run osmo-msc_10.42.42.6(pid=16318): Launched 11:54:34.698994 run osmo-stp_10.42.42.5(pid=16315): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16315)] 11:54:34.830243 run osmo-stp_10.42.42.5(pid=16315): stdout: | (launched: 2022-12-13_11:54:33.467337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:34.961763 run osmo-stp_10.42.42.5(pid=16315): stderr: | 20221213115433641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115433641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115433641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115433642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115433642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115433642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115433642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:35.090989 run osmo-stp_10.42.42.5(pid=16315): stdout: | (launched: 2022-12-13_11:54:33.467337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:35.214991 run osmo-stp_10.42.42.5(pid=16315): stderr: | 20221213115433641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115433641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115433641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115433642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115433642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115433642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115433642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:35.362903 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16315): Process ended prematurely: osmo-stp_10.42.42.5(pid=16315) [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16315)] [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 11:54:35.372124 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:54:35.398448 run osmo-hlr_10.42.42.2(pid=16312): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16312)] 11:54:35.446446 run osmo-hlr_10.42.42.2(pid=16312): stdout: | (launched: 2022-12-13_11:54:32.482565) 11:54:35.495693 run osmo-hlr_10.42.42.2(pid=16312): stderr: | 20221213115432666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115432666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115432666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115432666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115432666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115432666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115432678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115432687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115432687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115432687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:35.564566 run osmo-msc_10.42.42.6(pid=16318): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16318)] 11:54:35.612502 run osmo-msc_10.42.42.6(pid=16318): stdout: | (launched: 2022-12-13_11:54:34.466030) 11:54:35.661770 run osmo-msc_10.42.42.6(pid=16318): stderr: | 20221213115434741 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115434741 DLGLOBAL DEBUG validating counter group 0x7fcedb171c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115434741 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115434741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115434742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115434742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115434744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115434744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115434744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115434744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:35.711558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16311): Terminating (SIGTERM) 11:54:35.751292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16314): Terminating (SIGTERM) 11:54:35.791003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16317): Terminating (SIGTERM) 11:54:35.831241 --- ParallelTerminationStrategy: PID 16311 died... 11:54:35.850423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16311): Terminated: ok {rc=0} 11:54:35.894805 --- ParallelTerminationStrategy: PID 16314 died... 11:54:35.913703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16314): Terminated: ok {rc=0} 11:54:35.957731 --- ParallelTerminationStrategy: PID 16317 died... 11:54:35.976592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16317): Terminated: ok {rc=0} 11:54:36.063151 bus /sierra_3: Setting Powered False 11:54:37.162491 bus /sierra_3: Setting Powered False 11:54:38.275702 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:54:39.527231 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:39.535174 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:54:39.571844 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 11:54:39.599964 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 11:54:39.655703 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:54:39.690273 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 11:54:39.717265 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 11:54:40.267118 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 11:54:40.317067 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:40.328548 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:54:40.381314 tst mo_mt_call.py: using LAC 33768 11:54:40.503657 tst mo_mt_call.py: using RAC 108 11:54:40.627190 tst mo_mt_call.py: using CellId 33768 11:54:40.750709 tst mo_mt_call.py: using BVCI 33769 11:54:40.865403 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:40.876657 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:40.887929 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:40.899129 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:40.910452 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:40.921728 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:54:41.038758 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:54:41.160595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:41.678870 run create_hlr_db(pid=16323): Launched 11:54:41.806762 bus /sierra_2: Setting Powered False 11:54:42.871873 run create_hlr_db(pid=16323): Terminated: ok {rc=0} 11:54:43.319442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16325): Launched 11:54:43.633352 run osmo-hlr_10.42.42.2(pid=16326): Launched 11:54:43.752309 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:44.330724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16328): Launched 11:54:44.665899 run osmo-stp_10.42.42.5(pid=16329): Launched 11:54:44.794074 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:45.397172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16331): Launched 11:54:45.733096 run osmo-msc_10.42.42.6(pid=16332): Launched 11:54:46.002182 run osmo-stp_10.42.42.5(pid=16329): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16329)] 11:54:46.311347 run osmo-stp_10.42.42.5(pid=16329): stdout: | (launched: 2022-12-13_11:54:44.603507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:46.547118 run osmo-stp_10.42.42.5(pid=16329): stderr: | 20221213115444801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115444801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115444801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115444801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115444802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115444802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115444802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:46.683465 run osmo-stp_10.42.42.5(pid=16329): stdout: | (launched: 2022-12-13_11:54:44.603507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:46.811939 run osmo-stp_10.42.42.5(pid=16329): stderr: | 20221213115444801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115444801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115444801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115444801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115444802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115444802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115444802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:46.966794 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16329): Process ended prematurely: osmo-stp_10.42.42.5(pid=16329) [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16329)] [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 11:54:46.976784 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 11:54:47.004722 run osmo-hlr_10.42.42.2(pid=16326): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16326)] 11:54:47.054869 run osmo-hlr_10.42.42.2(pid=16326): stdout: | (launched: 2022-12-13_11:54:43.574797) 11:54:47.107699 run osmo-hlr_10.42.42.2(pid=16326): stderr: | 20221213115443755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115443755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115443755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115443755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115443755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115443755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115443767 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115443775 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115443775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115443775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:47.192391 run osmo-msc_10.42.42.6(pid=16332): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16332)] 11:54:47.246996 run osmo-msc_10.42.42.6(pid=16332): stdout: | (launched: 2022-12-13_11:54:45.670954) 11:54:47.302678 run osmo-msc_10.42.42.6(pid=16332): stderr: | 20221213115446084 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115446084 DLGLOBAL DEBUG validating counter group 0x7f027b23ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115446089 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115446089 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115446089 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115446089 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115446091 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115446091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115446092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115446092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:47.356844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16325): Terminating (SIGTERM) 11:54:47.399787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16328): Terminating (SIGTERM) 11:54:47.443929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16331): Terminating (SIGTERM) 11:54:47.488004 --- ParallelTerminationStrategy: PID 16325 died... 11:54:47.509300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16325): Terminated: ok {rc=0} 11:54:47.557619 --- ParallelTerminationStrategy: PID 16328 died... 11:54:47.578347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16328): Terminated: ok {rc=0} 11:54:47.626388 --- ParallelTerminationStrategy: PID 16331 died... 11:54:47.646648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16331): Terminated: ok {rc=0} 11:54:47.737737 bus /sierra_3: Setting Powered False 11:54:48.838612 bus /sierra_3: Setting Powered False 11:54:49.958505 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 11:54:51.111173 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:51.123975 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:54:51.181430 tst mo_mt_call_osmux.py: using LAC 33769 11:54:51.314166 tst mo_mt_call_osmux.py: using RAC 109 11:54:51.445868 tst mo_mt_call_osmux.py: using CellId 33769 11:54:51.577750 tst mo_mt_call_osmux.py: using BVCI 33770 11:54:51.700614 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:51.712586 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:51.724430 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:51.736194 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:51.748346 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:54:51.760394 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:54:51.879270 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:54:52.005500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:52.523039 run create_hlr_db(pid=16334): Launched 11:54:52.649724 bus /sierra_2: Setting Powered False 11:54:53.715479 run create_hlr_db(pid=16334): Terminated: ok {rc=0} 11:54:54.155703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16336): Launched 11:54:54.464504 run osmo-hlr_10.42.42.2(pid=16337): Launched 11:54:54.581276 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:55.125941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16339): Launched 11:54:55.434988 run osmo-stp_10.42.42.5(pid=16340): Launched 11:54:55.550750 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:56.103063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16342): Launched 11:54:56.410728 run osmo-msc_10.42.42.6(pid=16343): Launched 11:54:56.581824 run osmo-stp_10.42.42.5(pid=16340): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16340)] 11:54:56.710751 run osmo-stp_10.42.42.5(pid=16340): stdout: | (launched: 2022-12-13_11:54:55.376808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:56.839269 run osmo-stp_10.42.42.5(pid=16340): stderr: | 20221213115455550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115455551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115455551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115455551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115455552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115455552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115455552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:56.965579 run osmo-stp_10.42.42.5(pid=16340): stdout: | (launched: 2022-12-13_11:54:55.376808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:57.086292 run osmo-stp_10.42.42.5(pid=16340): stderr: | 20221213115455550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115455551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115455551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115455551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115455552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115455552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115455552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:57.231148 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16340): Process ended prematurely: osmo-stp_10.42.42.5(pid=16340) [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16340)] [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 11:54:57.240132 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:54:57.266156 run osmo-hlr_10.42.42.2(pid=16337): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16337)] 11:54:57.313399 run osmo-hlr_10.42.42.2(pid=16337): stdout: | (launched: 2022-12-13_11:54:54.406591) 11:54:57.362492 run osmo-hlr_10.42.42.2(pid=16337): stderr: | 20221213115454584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115454584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115454584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115454584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115454584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115454584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115454597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115454606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115454606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115454606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:57.431056 run osmo-msc_10.42.42.6(pid=16343): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16343)] 11:54:57.477941 run osmo-msc_10.42.42.6(pid=16343): stdout: | (launched: 2022-12-13_11:54:56.352243) 11:54:57.526764 run osmo-msc_10.42.42.6(pid=16343): stderr: | 20221213115456626 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115456626 DLGLOBAL DEBUG validating counter group 0x7f8ba0895c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115456626 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115456627 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115456627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115456627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115456630 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115456631 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115456631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115456631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:57.575838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16336): Terminating (SIGTERM) 11:54:57.615088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16339): Terminating (SIGTERM) 11:54:57.654792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16342): Terminating (SIGTERM) 11:54:57.694636 --- ParallelTerminationStrategy: PID 16336 died... 11:54:57.713573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16336): Terminated: ok {rc=0} 11:54:57.756916 --- ParallelTerminationStrategy: PID 16339 died... 11:54:57.775335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16339): Terminated: ok {rc=0} 11:54:57.818513 --- ParallelTerminationStrategy: PID 16342 died... 11:54:57.836838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16342): Terminated: ok {rc=0} 11:54:57.922075 bus /sierra_3: Setting Powered False 11:54:59.019428 bus /sierra_3: Setting Powered False 11:55:00.131573 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 emergency:trx-b200 --------------------------------------------------------------------- 11:55:01.455007 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:55:01.460478 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 11:55:01.509164 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:55:01.542447 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 11:55:01.655796 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 11:55:01.725999 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:55:01.767368 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 11:55:02.305091 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2389 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 11:55:02.310851 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:02.322238 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 11:55:02.372048 tst emergency_mo_mt_call.py: using LAC 33770 11:55:02.492141 tst emergency_mo_mt_call.py: using RAC 110 11:55:02.610536 tst emergency_mo_mt_call.py: using CellId 33770 11:55:02.730663 tst emergency_mo_mt_call.py: using BVCI 33771 11:55:02.840747 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:02.851805 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:02.862537 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:02.873265 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:02.883958 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:02.894679 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:55:03.014260 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:55:03.133347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:03.633514 run create_hlr_db(pid=16358): Launched 11:55:03.756890 bus /sierra_2: Setting Powered False 11:55:04.820609 run create_hlr_db(pid=16358): Terminated: ok {rc=0} 11:55:05.254063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16360): Launched 11:55:05.556022 run osmo-hlr_10.42.42.2(pid=16361): Launched 11:55:05.671184 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:06.209778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16363): Launched 11:55:06.513361 run osmo-stp_10.42.42.5(pid=16364): Launched 11:55:06.637881 tst emergency_mo_mt_call.py: using MSISDN 8144 11:55:06.792190 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:07.335600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16366): Launched 11:55:07.637223 run osmo-msc_10.42.42.6(pid=16367): Launched 11:55:07.803958 run osmo-stp_10.42.42.5(pid=16364): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16364)] 11:55:07.930165 run osmo-stp_10.42.42.5(pid=16364): stdout: | (launched: 2022-12-13_11:55:06.455861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:08.057265 run osmo-stp_10.42.42.5(pid=16364): stderr: | 20221213115506630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115506630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115506630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115506631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115506631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115506631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115506631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:08.182422 run osmo-stp_10.42.42.5(pid=16364): stdout: | (launched: 2022-12-13_11:55:06.455861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:08.301846 run osmo-stp_10.42.42.5(pid=16364): stderr: | 20221213115506630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115506630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115506630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115506631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115506631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115506631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115506631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:08.444318 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=16364): Process ended prematurely: osmo-stp_10.42.42.5(pid=16364) [trial-2389↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16364)] [trial-2389↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 11:55:08.452786 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 11:55:08.479196 run osmo-hlr_10.42.42.2(pid=16361): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16361)] 11:55:08.527242 run osmo-hlr_10.42.42.2(pid=16361): stdout: | (launched: 2022-12-13_11:55:05.499057) 11:55:08.576928 run osmo-hlr_10.42.42.2(pid=16361): stderr: | 20221213115505678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115505678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115505678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115505678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115505678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115505678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115505691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115505701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115505701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115505701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:08.645698 run osmo-msc_10.42.42.6(pid=16367): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16367)] 11:55:08.692703 run osmo-msc_10.42.42.6(pid=16367): stdout: | (launched: 2022-12-13_11:55:07.580223) 11:55:08.741696 run osmo-msc_10.42.42.6(pid=16367): stderr: | 20221213115507855 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115507855 DLGLOBAL DEBUG validating counter group 0x7f59541c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115507856 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115507856 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115507856 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115507856 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115507858 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115507858 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115507858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115507859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:08.791115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16360): Terminating (SIGTERM) 11:55:08.831118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16363): Terminating (SIGTERM) 11:55:08.871582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16366): Terminating (SIGTERM) 11:55:08.912123 --- ParallelTerminationStrategy: PID 16360 died... 11:55:08.931473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16360): Terminated: ok {rc=0} 11:55:08.975661 --- ParallelTerminationStrategy: PID 16363 died... 11:55:08.994609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16363): Terminated: ok {rc=0} 11:55:09.038871 --- ParallelTerminationStrategy: PID 16366 died... 11:55:09.057804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16366): Terminated: ok {rc=0} 11:55:09.144096 bus /sierra_3: Setting Powered False 11:55:10.244411 bus /sierra_3: Setting Powered False 11:55:11.361386 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 11:55:12.450293 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:12.463331 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 11:55:12.521122 tst emergency_preemptive_call.py: using LAC 33771 11:55:12.650286 tst emergency_preemptive_call.py: using RAC 111 11:55:12.783026 tst emergency_preemptive_call.py: using CellId 33771 11:55:12.912357 tst emergency_preemptive_call.py: using BVCI 33772 11:55:13.033904 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:13.046179 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:13.058169 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:13.071048 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:13.084449 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:55:13.097508 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:55:13.222661 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:55:13.334324 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:55:13.444442 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:55:13.559325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:14.068660 run create_hlr_db(pid=16650): Launched 11:55:14.213616 bus /sierra_2: Setting Powered False 11:55:15.274076 run create_hlr_db(pid=16650): Terminated: ok {rc=0} 11:55:15.711081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16726): Launched 11:55:16.035426 run osmo-hlr_10.42.42.2(pid=16727): Launched 11:55:16.190553 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:16.906336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16729): Launched 11:55:17.226905 run osmo-stp_10.42.42.5(pid=16730): Launched 11:55:17.388639 tst emergency_preemptive_call.py: using MSISDN 8145 11:55:17.563188 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:18.143032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16732): Launched 11:55:18.467267 run osmo-msc_10.42.42.6(pid=16733): Launched 11:55:18.647276 run osmo-stp_10.42.42.5(pid=16730): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16730)] 11:55:18.783629 run osmo-stp_10.42.42.5(pid=16730): stdout: | (launched: 2022-12-13_11:55:17.167700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:18.920324 run osmo-stp_10.42.42.5(pid=16730): stderr: | 20221213115517384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115517384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115517384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115517384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115517387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115517387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115517387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:19.056186 run osmo-stp_10.42.42.5(pid=16730): stdout: | (launched: 2022-12-13_11:55:17.167700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:19.185588 run osmo-stp_10.42.42.5(pid=16730): stderr: | 20221213115517384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115517384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115517384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115517384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115517387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115517387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115517387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:19.339250 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=16730): Process ended prematurely: osmo-stp_10.42.42.5(pid=16730) [trial-2389↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16730)] [trial-2389↪emergency:trx-b200↪emergency_preemptive_call.py:32] 11:55:19.348421 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 11:55:19.375952 run osmo-hlr_10.42.42.2(pid=16727): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16727)] 11:55:19.427379 run osmo-hlr_10.42.42.2(pid=16727): stdout: | (launched: 2022-12-13_11:55:15.967209) 11:55:19.479809 run osmo-hlr_10.42.42.2(pid=16727): stderr: | 20221213115516335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115516335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115516335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115516335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115516335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115516336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115516359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115516376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115516376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115516376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:19.552823 run osmo-msc_10.42.42.6(pid=16733): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16733)] 11:55:19.603329 run osmo-msc_10.42.42.6(pid=16733): stdout: | (launched: 2022-12-13_11:55:18.406572) 11:55:19.655592 run osmo-msc_10.42.42.6(pid=16733): stderr: | 20221213115518730 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213115518730 DLGLOBAL DEBUG validating counter group 0x7ff1f3e6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213115518730 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213115518730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213115518731 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213115518731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213115518734 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213115518735 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213115518735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213115518735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:19.708261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16726): Terminating (SIGTERM) 11:55:19.750246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16729): Terminating (SIGTERM) 11:55:19.792625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16732): Terminating (SIGTERM) 11:55:19.835499 --- ParallelTerminationStrategy: PID 16726 died... 11:55:19.856037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16726): Terminated: ok {rc=0} 11:55:19.903271 --- ParallelTerminationStrategy: PID 16729 died... 11:55:19.923170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16729): Terminated: ok {rc=0} 11:55:19.969836 --- ParallelTerminationStrategy: PID 16732 died... 11:55:19.989840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16732): Terminated: ok {rc=0} 11:55:20.079125 bus /sierra_9: Setting Powered False 11:55:21.177845 bus /sierra_9: Setting Powered False 11:55:22.294782 bus /sierra_8: Setting Powered False 11:55:23.395057 bus /sierra_8: Setting Powered False 11:55:24.515446 bus /sierra_3: Setting Powered False 11:55:25.618871 bus /sierra_3: Setting Powered False 11:55:26.738733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-b200 --------------------------------------------------------------------- 11:55:28.032940 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:55:28.038422 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 11:55:28.077755 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 11:55:28.121610 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 11:55:28.213983 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 11:55:28.249221 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 11:55:28.292286 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 11:55:28.878926 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 11:55:28.928597 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:28.939295 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:55:28.987310 tst cs_paging_gprs_active.py: using LAC 33772 11:55:29.116775 tst cs_paging_gprs_active.py: using RAC 112 11:55:29.244580 tst cs_paging_gprs_active.py: using CellId 33772 11:55:29.371487 tst cs_paging_gprs_active.py: using BVCI 33773 11:55:29.491501 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:29.502799 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:29.514035 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:29.525264 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:29.536474 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:29.547806 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:29.559357 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:29.570800 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:29.582427 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:55:29.699237 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:55:29.820358 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:55:30.043446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:30.375609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16914): Launched 11:55:30.663593 run iperf3-srv_10.42.42.10(pid=16915): Launched 11:55:30.790416 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:55:31.039917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:31.397155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16916): Launched 11:55:31.729549 run iperf3-srv_10.42.42.10(pid=16917): Launched 11:55:31.867720 tst cs_paging_gprs_active.py:38: start network... 11:55:32.096428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:32.612467 run create_hlr_db(pid=16918): Launched 11:55:32.739364 bus /sierra_2: Setting Powered False 11:55:33.804864 run create_hlr_db(pid=16918): Terminated: ok {rc=0} 11:55:34.245311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16920): Launched 11:55:34.554476 run osmo-hlr_10.42.42.2(pid=16921): Launched 11:55:34.696049 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:35.290459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16923): Launched 11:55:35.596363 run osmo-stp_10.42.42.5(pid=16924): Launched 11:55:35.714186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:55:36.239924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16926): Launched 11:55:36.357501 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:55:36.618114 run patchelf(pid=16927): Launched 11:55:36.790772 run osmo-stp_10.42.42.5(pid=16924): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16924)] 11:55:36.920811 run osmo-stp_10.42.42.5(pid=16924): stdout: | (launched: 2022-12-13_11:55:35.540426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:37.052693 run osmo-stp_10.42.42.5(pid=16924): stderr: | 20221213115535717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115535718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115535718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115535718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115535719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115535719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115535719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:37.184797 run osmo-stp_10.42.42.5(pid=16924): stdout: | (launched: 2022-12-13_11:55:35.540426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:37.310312 run osmo-stp_10.42.42.5(pid=16924): stderr: | 20221213115535717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115535718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115535718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115535718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115535719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115535719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115535719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:37.458791 run patchelf(pid=16927): Terminating (SIGINT) 11:55:37.631037 run patchelf(pid=16927): Terminated: ok {rc=0} 11:55:37.754682 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16924): Process ended prematurely: osmo-stp_10.42.42.5(pid=16924) [trial-2389↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16924)] [trial-2389↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 11:55:37.764077 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:55:37.791199 run osmo-hlr_10.42.42.2(pid=16921): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16921)] 11:55:37.838290 run osmo-hlr_10.42.42.2(pid=16921): stdout: | (launched: 2022-12-13_11:55:34.496737) 11:55:37.887029 run osmo-hlr_10.42.42.2(pid=16921): stderr: | 20221213115534706 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115534706 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115534706 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115534706 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115534706 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115534706 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115534719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115534731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115534732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115534732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:37.936138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16914): Terminating (SIGTERM) 11:55:37.975565 run iperf3-srv_10.42.42.10(pid=16915): Terminating (SIGTERM) 11:55:38.014998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16916): Terminating (SIGTERM) 11:55:38.054348 run iperf3-srv_10.42.42.10(pid=16917): Terminating (SIGTERM) 11:55:38.093527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16920): Terminating (SIGTERM) 11:55:38.133103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16923): Terminating (SIGTERM) 11:55:38.172399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16926): Terminating (SIGTERM) 11:55:38.212335 --- ParallelTerminationStrategy: PID 16914 died... 11:55:38.231471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16914): Terminated: ok {rc=0} 11:55:38.275406 --- ParallelTerminationStrategy: PID 16915 died... 11:55:38.293843 run iperf3-srv_10.42.42.10(pid=16915): Terminated {rc=256} 11:55:38.337037 --- ParallelTerminationStrategy: PID 16916 died... 11:55:38.355226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16916): Terminated: ok {rc=0} 11:55:38.398345 --- ParallelTerminationStrategy: PID 16917 died... 11:55:38.416761 run iperf3-srv_10.42.42.10(pid=16917): Terminated {rc=256} 11:55:38.459789 --- ParallelTerminationStrategy: PID 16920 died... 11:55:38.478264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16920): Terminated: ok {rc=0} 11:55:38.521958 --- ParallelTerminationStrategy: PID 16923 died... 11:55:38.540436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16923): Terminated: ok {rc=0} 11:55:38.584680 --- ParallelTerminationStrategy: PID 16926 died... 11:55:38.603401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16926): Terminated: ok {rc=0} 11:55:38.689273 bus /gobi_0: Setting Powered False 11:55:39.789175 bus /gobi_0: Setting Powered False 11:55:40.907511 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200 iperf3.py ---------------------------------------------- 11:55:42.057823 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:42.069782 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:55:42.127960 tst iperf3.py: using LAC 33773 11:55:42.256271 tst iperf3.py: using RAC 113 11:55:42.384809 tst iperf3.py: using CellId 33773 11:55:42.512405 tst iperf3.py: using BVCI 33774 11:55:42.632075 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:42.643369 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:42.654328 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:42.665368 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:42.676504 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:42.687705 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:42.699110 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:42.710289 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:42.721626 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:55:42.838200 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:55:43.043736 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:43.349791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16928): Launched 11:55:43.618885 run iperf3-srv_10.42.42.10(pid=16929): Launched 11:55:43.734718 tst iperf3.py:8: start network... 11:55:43.939176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:44.409028 run create_hlr_db(pid=16930): Launched 11:55:44.533957 bus /gobi_6: Setting Powered False 11:55:45.595192 run create_hlr_db(pid=16930): Terminated: ok {rc=0} 11:55:46.065711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16932): Launched 11:55:46.393725 run osmo-hlr_10.42.42.2(pid=16933): Launched 11:55:46.629389 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:47.365308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16935): Launched 11:55:47.704540 run osmo-stp_10.42.42.5(pid=16936): Launched 11:55:47.831849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:55:48.395684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16938): Launched 11:55:48.521633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:55:48.797210 run patchelf(pid=16939): Launched 11:55:48.981194 run osmo-stp_10.42.42.5(pid=16936): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16936)] 11:55:49.119900 run osmo-stp_10.42.42.5(pid=16936): stdout: | (launched: 2022-12-13_11:55:47.645432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:49.260617 run osmo-stp_10.42.42.5(pid=16936): stderr: | 20221213115547832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115547832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115547833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115547833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115547834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115547834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115547834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:49.401379 run osmo-stp_10.42.42.5(pid=16936): stdout: | (launched: 2022-12-13_11:55:47.645432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:49.535581 run osmo-stp_10.42.42.5(pid=16936): stderr: | 20221213115547832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115547832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115547833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115547833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115547834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115547834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115547834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:49.695093 run patchelf(pid=16939): Terminating (SIGINT) 11:55:49.877282 run patchelf(pid=16939): Terminated: ok {rc=0} 11:55:50.009415 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16936): Process ended prematurely: osmo-stp_10.42.42.5(pid=16936) [trial-2389↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16936)] [trial-2389↪gprs:trx-b200↪iperf3.py:8] 11:55:50.019614 tst iperf3.py:8: Test FAILED (8.0 sec) 11:55:50.048306 run osmo-hlr_10.42.42.2(pid=16933): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16933)] 11:55:50.099139 run osmo-hlr_10.42.42.2(pid=16933): stdout: | (launched: 2022-12-13_11:55:46.329305) 11:55:50.151372 run osmo-hlr_10.42.42.2(pid=16933): stderr: | 20221213115546695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115546695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115546695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115546695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115546695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115546695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115546718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115546736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115546736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115546736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:50.203492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16928): Terminating (SIGTERM) 11:55:50.245215 run iperf3-srv_10.42.42.10(pid=16929): Terminating (SIGTERM) 11:55:50.287389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16932): Terminating (SIGTERM) 11:55:50.329743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16935): Terminating (SIGTERM) 11:55:50.371915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16938): Terminating (SIGTERM) 11:55:50.414451 --- ParallelTerminationStrategy: PID 16928 died... 11:55:50.434995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16928): Terminated: ok {rc=0} 11:55:50.481643 --- ParallelTerminationStrategy: PID 16929 died... 11:55:50.501442 run iperf3-srv_10.42.42.10(pid=16929): Terminated {rc=256} 11:55:50.547717 --- ParallelTerminationStrategy: PID 16932 died... 11:55:50.567585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16932): Terminated: ok {rc=0} 11:55:50.613509 --- ParallelTerminationStrategy: PID 16935 died... 11:55:50.633224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16935): Terminated: ok {rc=0} 11:55:50.679358 --- ParallelTerminationStrategy: PID 16938 died... 11:55:50.699252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16938): Terminated: ok {rc=0} 11:55:50.787543 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 11:55:51.939072 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:51.950573 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:55:52.000763 tst iperf3m4.py: using LAC 33774 11:55:52.130285 tst iperf3m4.py: using RAC 114 11:55:52.258637 tst iperf3m4.py: using CellId 33774 11:55:52.388313 tst iperf3m4.py: using BVCI 33775 11:55:52.509212 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:52.520442 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:52.531460 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:52.542771 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:52.554578 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:52.566395 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:52.578421 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:52.590340 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:55:52.602282 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:55:52.722693 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:55:52.845381 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:55:52.967119 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:55:53.085040 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:55:53.290397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:53.597021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16940): Launched 11:55:53.863766 run iperf3-srv_10.42.42.10(pid=16941): Launched 11:55:53.978495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:55:54.183371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:54.491801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16942): Launched 11:55:54.757662 run iperf3-srv_10.42.42.10(pid=16943): Launched 11:55:54.873760 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:55:55.080434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:55.389106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16944): Launched 11:55:55.654756 run iperf3-srv_10.42.42.10(pid=16945): Launched 11:55:55.769247 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:55:55.974551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:55:56.281785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16946): Launched 11:55:56.548677 run iperf3-srv_10.42.42.10(pid=16947): Launched 11:55:56.663365 tst iperf3m4.py:8: start network... 11:55:56.869609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:57.342725 run create_hlr_db(pid=16948): Launched 11:55:57.469895 bus /gobi_6: Setting Powered False 11:55:58.534446 run create_hlr_db(pid=16948): Terminated: ok {rc=0} 11:55:58.972443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16950): Launched 11:55:59.277676 run osmo-hlr_10.42.42.2(pid=16951): Launched 11:55:59.393602 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:59.954045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16953): Launched 11:56:00.263222 run osmo-stp_10.42.42.5(pid=16954): Launched 11:56:00.378824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:00.931991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16956): Launched 11:56:01.063509 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:01.328159 run patchelf(pid=16957): Launched 11:56:01.517116 run osmo-stp_10.42.42.5(pid=16954): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16954)] 11:56:01.650159 run osmo-stp_10.42.42.5(pid=16954): stdout: | (launched: 2022-12-13_11:56:00.206738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:01.785085 run osmo-stp_10.42.42.5(pid=16954): stderr: | 20221213115600377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115600377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115600377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115600378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115600378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115600378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115600378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:01.920474 run osmo-stp_10.42.42.5(pid=16954): stdout: | (launched: 2022-12-13_11:56:00.206738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:02.048214 run osmo-stp_10.42.42.5(pid=16954): stderr: | 20221213115600377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115600377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115600377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115600378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115600378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115600378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115600378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:02.200538 run patchelf(pid=16957): Terminating (SIGINT) 11:56:02.372321 run patchelf(pid=16957): Terminated: ok {rc=0} 11:56:02.496392 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16954): Process ended prematurely: osmo-stp_10.42.42.5(pid=16954) [trial-2389↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16954)] [trial-2389↪gprs:trx-b200↪iperf3m4.py:8] 11:56:02.506338 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:56:02.534178 run osmo-hlr_10.42.42.2(pid=16951): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16951)] 11:56:02.582032 run osmo-hlr_10.42.42.2(pid=16951): stdout: | (launched: 2022-12-13_11:55:59.221965) 11:56:02.631619 run osmo-hlr_10.42.42.2(pid=16951): stderr: | 20221213115559397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115559397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115559397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115559397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115559397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115559397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115559506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115559519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115559520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115559520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:02.681884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16940): Terminating (SIGTERM) 11:56:02.722128 run iperf3-srv_10.42.42.10(pid=16941): Terminating (SIGTERM) 11:56:02.762541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16942): Terminating (SIGTERM) 11:56:02.802645 run iperf3-srv_10.42.42.10(pid=16943): Terminating (SIGTERM) 11:56:02.842542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16944): Terminating (SIGTERM) 11:56:02.883123 run iperf3-srv_10.42.42.10(pid=16945): Terminating (SIGTERM) 11:56:02.923776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16946): Terminating (SIGTERM) 11:56:02.963706 run iperf3-srv_10.42.42.10(pid=16947): Terminating (SIGTERM) 11:56:03.003585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16950): Terminating (SIGTERM) 11:56:03.043508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16953): Terminating (SIGTERM) 11:56:03.083495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16956): Terminating (SIGTERM) 11:56:03.123754 --- ParallelTerminationStrategy: PID 16940 died... 11:56:03.143275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16940): Terminated: ok {rc=0} 11:56:03.187745 --- ParallelTerminationStrategy: PID 16941 died... 11:56:03.206576 run iperf3-srv_10.42.42.10(pid=16941): Terminated {rc=256} 11:56:03.250730 --- ParallelTerminationStrategy: PID 16942 died... 11:56:03.269551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16942): Terminated: ok {rc=0} 11:56:03.313835 --- ParallelTerminationStrategy: PID 16943 died... 11:56:03.332582 run iperf3-srv_10.42.42.10(pid=16943): Terminated {rc=256} 11:56:03.376884 --- ParallelTerminationStrategy: PID 16944 died... 11:56:03.396099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16944): Terminated: ok {rc=0} 11:56:03.440344 --- ParallelTerminationStrategy: PID 16945 died... 11:56:03.459256 run iperf3-srv_10.42.42.10(pid=16945): Terminated {rc=256} 11:56:03.503526 --- ParallelTerminationStrategy: PID 16946 died... 11:56:03.522512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16946): Terminated: ok {rc=0} 11:56:03.566899 --- ParallelTerminationStrategy: PID 16947 died... 11:56:03.585805 run iperf3-srv_10.42.42.10(pid=16947): Terminated {rc=256} 11:56:03.630013 --- ParallelTerminationStrategy: PID 16950 died... 11:56:03.648781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16950): Terminated: ok {rc=0} 11:56:03.693063 --- ParallelTerminationStrategy: PID 16953 died... 11:56:03.712012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16953): Terminated: ok {rc=0} 11:56:03.756257 --- ParallelTerminationStrategy: PID 16956 died... 11:56:03.775411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16956): Terminated: ok {rc=0} 11:56:03.860273 bus /gobi_4: Setting Powered False 11:56:04.958847 bus /gobi_4: Setting Powered False 11:56:06.076452 bus /gobi_1: Setting Powered False 11:56:07.175904 bus /gobi_1: Setting Powered False 11:56:08.293128 bus /gobi_0: Setting Powered False 11:56:09.391472 bus /gobi_0: Setting Powered False 11:56:10.509159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200 ping.py ---------------------------------------------- 11:56:11.612287 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:11.624417 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:56:11.677194 tst ping.py: using LAC 33775 11:56:11.805519 tst ping.py: using RAC 115 11:56:11.924058 tst ping.py: using CellId 33775 11:56:12.044330 tst ping.py: using BVCI 33776 11:56:12.155460 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:12.166294 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:12.176752 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:12.187333 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:12.197773 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:12.208271 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:12.219395 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:12.230163 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:56:12.348864 tst ping.py:19: start network... 11:56:12.552279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:13.017752 run create_hlr_db(pid=16958): Launched 11:56:13.139630 bus /gobi_6: Setting Powered False 11:56:14.200309 run create_hlr_db(pid=16958): Terminated: ok {rc=0} 11:56:14.620226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16960): Launched 11:56:14.920482 run osmo-hlr_10.42.42.2(pid=16961): Launched 11:56:15.036502 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:15.560150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16963): Launched 11:56:15.862726 run osmo-stp_10.42.42.5(pid=16964): Launched 11:56:16.020299 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:16.717633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16966): Launched 11:56:16.837896 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:17.101849 run patchelf(pid=16967): Launched 11:56:17.330354 run osmo-stp_10.42.42.5(pid=16964): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16964)] 11:56:17.459092 run osmo-stp_10.42.42.5(pid=16964): stdout: | (launched: 2022-12-13_11:56:15.806256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:17.587598 run osmo-stp_10.42.42.5(pid=16964): stderr: | 20221213115616177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115616177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115616177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115616177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115616178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115616178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115616178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:17.716169 run osmo-stp_10.42.42.5(pid=16964): stdout: | (launched: 2022-12-13_11:56:15.806256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:17.838800 run osmo-stp_10.42.42.5(pid=16964): stderr: | 20221213115616177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115616177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115616177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115616177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115616178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115616178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115616178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:17.984065 run patchelf(pid=16967): Terminating (SIGINT) 11:56:18.152219 run patchelf(pid=16967): Terminated: ok {rc=0} 11:56:18.273634 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16964): Process ended prematurely: osmo-stp_10.42.42.5(pid=16964) [trial-2389↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16964)] [trial-2389↪gprs:trx-b200↪ping.py:22] 11:56:18.282573 tst ping.py:22: Test FAILED (6.7 sec) 11:56:18.309579 run osmo-hlr_10.42.42.2(pid=16961): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16961)] 11:56:18.357309 run osmo-hlr_10.42.42.2(pid=16961): stdout: | (launched: 2022-12-13_11:56:14.864886) 11:56:18.406579 run osmo-hlr_10.42.42.2(pid=16961): stderr: | 20221213115615042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115615042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115615042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115615042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115615042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115615042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115615053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115615062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115615062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115615062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:18.456311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16960): Terminating (SIGTERM) 11:56:18.496132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16963): Terminating (SIGTERM) 11:56:18.535914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16966): Terminating (SIGTERM) 11:56:18.575807 --- ParallelTerminationStrategy: PID 16960 died... 11:56:18.594919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16960): Terminated: ok {rc=0} 11:56:18.639100 --- ParallelTerminationStrategy: PID 16963 died... 11:56:18.657919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16963): Terminated: ok {rc=0} 11:56:18.701791 --- ParallelTerminationStrategy: PID 16966 died... 11:56:18.720395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16966): Terminated: ok {rc=0} 11:56:18.806658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 11:56:19.895590 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:19.907163 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:56:19.960163 tst ping_idle_ping.py: using LAC 33776 11:56:20.081375 tst ping_idle_ping.py: using RAC 116 11:56:20.198237 tst ping_idle_ping.py: using CellId 33776 11:56:20.317406 tst ping_idle_ping.py: using BVCI 33777 11:56:20.435579 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:20.447256 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:20.458549 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:20.469723 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:20.481200 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:20.492665 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:20.504150 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:56:20.515559 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:56:20.631620 tst ping_idle_ping.py:24: start network... 11:56:20.834118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:21.303031 run create_hlr_db(pid=16968): Launched 11:56:21.426543 bus /gobi_6: Setting Powered False 11:56:22.486816 run create_hlr_db(pid=16968): Terminated: ok {rc=0} 11:56:22.907576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16970): Launched 11:56:23.209729 run osmo-hlr_10.42.42.2(pid=16971): Launched 11:56:23.324532 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:23.856518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16973): Launched 11:56:24.158499 run osmo-stp_10.42.42.5(pid=16974): Launched 11:56:24.274375 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:24.794130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16976): Launched 11:56:24.911354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:25.165672 run patchelf(pid=16977): Launched 11:56:25.334752 run osmo-stp_10.42.42.5(pid=16974): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16974)] 11:56:25.462990 run osmo-stp_10.42.42.5(pid=16974): stdout: | (launched: 2022-12-13_11:56:24.103098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:25.592757 run osmo-stp_10.42.42.5(pid=16974): stderr: | 20221213115624270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115624270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115624270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115624271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115624271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115624271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115624271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:25.722600 run osmo-stp_10.42.42.5(pid=16974): stdout: | (launched: 2022-12-13_11:56:24.103098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:25.846512 run osmo-stp_10.42.42.5(pid=16974): stderr: | 20221213115624270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115624270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115624270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115624271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115624271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115624271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115624271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:25.993259 run patchelf(pid=16977): Terminating (SIGINT) 11:56:26.162690 run patchelf(pid=16977): Terminated: ok {rc=0} 11:56:26.284817 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16974): Process ended prematurely: osmo-stp_10.42.42.5(pid=16974) [trial-2389↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16974)] [trial-2389↪gprs:trx-b200↪ping_idle_ping.py:27] 11:56:26.293923 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:56:26.320789 run osmo-hlr_10.42.42.2(pid=16971): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16971)] 11:56:26.368585 run osmo-hlr_10.42.42.2(pid=16971): stdout: | (launched: 2022-12-13_11:56:23.154286) 11:56:26.418180 run osmo-hlr_10.42.42.2(pid=16971): stderr: | 20221213115623325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115623325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115623325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115623325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115623325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115623325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115623338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115623346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115623346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115623346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:26.468071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16970): Terminating (SIGTERM) 11:56:26.508103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16973): Terminating (SIGTERM) 11:56:26.548156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16976): Terminating (SIGTERM) 11:56:26.588300 --- ParallelTerminationStrategy: PID 16970 died... 11:56:26.607429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16970): Terminated: ok {rc=0} 11:56:26.651918 --- ParallelTerminationStrategy: PID 16973 died... 11:56:26.670876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16973): Terminated: ok {rc=0} 11:56:26.715128 --- ParallelTerminationStrategy: PID 16976 died... 11:56:26.733940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16976): Terminated: ok {rc=0} 11:56:26.820292 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 11:56:28.134466 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:56:28.139563 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:56:28.172474 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:56:28.212117 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:56:28.298331 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:56:28.331071 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:56:28.369595 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:56:28.965141 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:56:29.014796 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:29.025633 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:56:29.074802 tst cs_paging_gprs_active.py: using LAC 33777 11:56:29.195391 tst cs_paging_gprs_active.py: using RAC 117 11:56:29.317596 tst cs_paging_gprs_active.py: using CellId 33777 11:56:29.437341 tst cs_paging_gprs_active.py: using BVCI 33778 11:56:29.547965 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:29.558939 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:29.569655 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:29.580268 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:29.590903 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:29.601561 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:29.612369 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:29.622989 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:29.633880 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:56:29.753539 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:56:29.870623 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:56:30.077546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:30.386723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16982): Launched 11:56:30.653718 run iperf3-srv_10.42.42.10(pid=16983): Launched 11:56:30.769569 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:56:30.978211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:31.293239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16984): Launched 11:56:31.577941 run iperf3-srv_10.42.42.10(pid=16985): Launched 11:56:31.710642 tst cs_paging_gprs_active.py:38: start network... 11:56:31.919630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:32.398685 run create_hlr_db(pid=16986): Launched 11:56:32.522961 bus /gobi_6: Setting Powered False 11:56:33.583366 run create_hlr_db(pid=16986): Terminated: ok {rc=0} 11:56:34.008166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16988): Launched 11:56:34.313482 run osmo-hlr_10.42.42.2(pid=16989): Launched 11:56:34.430192 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:34.956607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16991): Launched 11:56:35.263255 run osmo-stp_10.42.42.5(pid=16992): Launched 11:56:35.379702 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:35.906621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16994): Launched 11:56:36.023539 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:36.282114 run patchelf(pid=16995): Launched 11:56:36.452702 run osmo-stp_10.42.42.5(pid=16992): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16992)] 11:56:36.582140 run osmo-stp_10.42.42.5(pid=16992): stdout: | (launched: 2022-12-13_11:56:35.207266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:36.713333 run osmo-stp_10.42.42.5(pid=16992): stderr: | 20221213115635377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115635378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115635378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115635378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115635379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115635379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115635379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:36.845094 run osmo-stp_10.42.42.5(pid=16992): stdout: | (launched: 2022-12-13_11:56:35.207266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:36.969774 run osmo-stp_10.42.42.5(pid=16992): stderr: | 20221213115635377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115635378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115635378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115635378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115635379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115635379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115635379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:37.118208 run patchelf(pid=16995): Terminating (SIGINT) 11:56:37.290583 run patchelf(pid=16995): Terminated: ok {rc=0} 11:56:37.414211 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16992): Process ended prematurely: osmo-stp_10.42.42.5(pid=16992) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16992)] [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:56:37.423758 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 11:56:37.450898 run osmo-hlr_10.42.42.2(pid=16989): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16989)] 11:56:37.498324 run osmo-hlr_10.42.42.2(pid=16989): stdout: | (launched: 2022-12-13_11:56:34.257725) 11:56:37.547391 run osmo-hlr_10.42.42.2(pid=16989): stderr: | 20221213115634432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115634432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115634432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115634432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115634432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115634432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115634447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115634457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115634457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115634458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:37.596860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16982): Terminating (SIGTERM) 11:56:37.636415 run iperf3-srv_10.42.42.10(pid=16983): Terminating (SIGTERM) 11:56:37.675785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16984): Terminating (SIGTERM) 11:56:37.715244 run iperf3-srv_10.42.42.10(pid=16985): Terminating (SIGTERM) 11:56:37.754636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16988): Terminating (SIGTERM) 11:56:37.794568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16991): Terminating (SIGTERM) 11:56:37.834613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16994): Terminating (SIGTERM) 11:56:37.874610 --- ParallelTerminationStrategy: PID 16982 died... 11:56:37.893664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16982): Terminated: ok {rc=0} 11:56:37.937120 --- ParallelTerminationStrategy: PID 16983 died... 11:56:37.955367 run iperf3-srv_10.42.42.10(pid=16983): Terminated {rc=256} 11:56:37.998657 --- ParallelTerminationStrategy: PID 16984 died... 11:56:38.017105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16984): Terminated: ok {rc=0} 11:56:38.060664 --- ParallelTerminationStrategy: PID 16985 died... 11:56:38.079160 run iperf3-srv_10.42.42.10(pid=16985): Terminated {rc=256} 11:56:38.122338 --- ParallelTerminationStrategy: PID 16988 died... 11:56:38.140681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16988): Terminated: ok {rc=0} 11:56:38.183941 --- ParallelTerminationStrategy: PID 16991 died... 11:56:38.202378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16991): Terminated: ok {rc=0} 11:56:38.245535 --- ParallelTerminationStrategy: PID 16994 died... 11:56:38.263969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16994): Terminated: ok {rc=0} 11:56:38.348636 bus /gobi_0: Setting Powered False 11:56:39.448160 bus /gobi_0: Setting Powered False 11:56:40.563826 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:56:41.706344 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:41.718026 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:56:41.776623 tst iperf3.py: using LAC 33778 11:56:41.898395 tst iperf3.py: using RAC 118 11:56:42.021513 tst iperf3.py: using CellId 33778 11:56:42.141157 tst iperf3.py: using BVCI 33779 11:56:42.252112 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:42.263155 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:42.273870 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:42.284564 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:42.295292 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:42.305993 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:42.316773 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:42.327412 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:42.338228 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:56:42.453365 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:56:42.659924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:42.967995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16996): Launched 11:56:43.237024 run iperf3-srv_10.42.42.10(pid=16997): Launched 11:56:43.352057 tst iperf3.py:8: start network... 11:56:43.557568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:44.030579 run create_hlr_db(pid=16998): Launched 11:56:44.155328 bus /gobi_6: Setting Powered False 11:56:45.217129 run create_hlr_db(pid=16998): Terminated: ok {rc=0} 11:56:45.647912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17000): Launched 11:56:45.973756 run osmo-hlr_10.42.42.2(pid=17001): Launched 11:56:46.322727 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:46.965728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17003): Launched 11:56:47.288326 run osmo-stp_10.42.42.5(pid=17004): Launched 11:56:47.417588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:56:47.983708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17006): Launched 11:56:48.109835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:56:48.386880 run patchelf(pid=17007): Launched 11:56:48.570867 run osmo-stp_10.42.42.5(pid=17004): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17004)] 11:56:48.710167 run osmo-stp_10.42.42.5(pid=17004): stdout: | (launched: 2022-12-13_11:56:47.230658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:48.851160 run osmo-stp_10.42.42.5(pid=17004): stderr: | 20221213115647424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115647424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115647424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115647425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115647425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115647425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115647425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:48.991948 run osmo-stp_10.42.42.5(pid=17004): stdout: | (launched: 2022-12-13_11:56:47.230658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:49.126287 run osmo-stp_10.42.42.5(pid=17004): stderr: | 20221213115647424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115647424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115647424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115647425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115647425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115647425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115647425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:49.286145 run patchelf(pid=17007): Terminating (SIGINT) 11:56:49.469334 run patchelf(pid=17007): Terminated: ok {rc=0} 11:56:49.601966 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17004): Process ended prematurely: osmo-stp_10.42.42.5(pid=17004) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17004)] [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 11:56:49.612245 tst iperf3.py:8: Test FAILED (7.9 sec) 11:56:49.640590 run osmo-hlr_10.42.42.2(pid=17001): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17001)] 11:56:49.691361 run osmo-hlr_10.42.42.2(pid=17001): stdout: | (launched: 2022-12-13_11:56:45.898640) 11:56:49.743253 run osmo-hlr_10.42.42.2(pid=17001): stderr: | 20221213115646245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115646245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115646245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115646245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115646245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115646245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115646262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115646275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115646275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115646275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:49.795578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16996): Terminating (SIGTERM) 11:56:49.837030 run iperf3-srv_10.42.42.10(pid=16997): Terminating (SIGTERM) 11:56:49.878724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17000): Terminating (SIGTERM) 11:56:49.920541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17003): Terminating (SIGTERM) 11:56:49.962385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17006): Terminating (SIGTERM) 11:56:50.004303 --- ParallelTerminationStrategy: PID 16996 died... 11:56:50.024602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16996): Terminated: ok {rc=0} 11:56:50.071533 --- ParallelTerminationStrategy: PID 16997 died... 11:56:50.091517 run iperf3-srv_10.42.42.10(pid=16997): Terminated {rc=256} 11:56:50.137885 --- ParallelTerminationStrategy: PID 17000 died... 11:56:50.157737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17000): Terminated: ok {rc=0} 11:56:50.204139 --- ParallelTerminationStrategy: PID 17003 died... 11:56:50.224175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17003): Terminated: ok {rc=0} 11:56:50.270271 --- ParallelTerminationStrategy: PID 17006 died... 11:56:50.290349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17006): Terminated: ok {rc=0} 11:56:50.380197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:56:51.530459 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:51.542472 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:56:51.595762 tst iperf3m4.py: using LAC 33779 11:56:51.727054 tst iperf3m4.py: using RAC 119 11:56:51.857588 tst iperf3m4.py: using CellId 33779 11:56:51.988108 tst iperf3m4.py: using BVCI 33780 11:56:52.107569 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:52.119087 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:52.130478 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:52.141621 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:52.153193 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:52.165105 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:52.176729 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:52.188144 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:56:52.199758 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:56:52.317171 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:56:52.439508 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:56:52.557757 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:56:52.679318 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:56:52.901818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:53.230936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17008): Launched 11:56:53.518184 run iperf3-srv_10.42.42.10(pid=17009): Launched 11:56:53.641730 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:56:53.863196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:54.192264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17010): Launched 11:56:54.477699 run iperf3-srv_10.42.42.10(pid=17011): Launched 11:56:54.602849 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:56:54.826086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:55.156138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17012): Launched 11:56:55.445090 run iperf3-srv_10.42.42.10(pid=17013): Launched 11:56:55.567951 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:56:55.790066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:56:56.119181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17014): Launched 11:56:56.406773 run iperf3-srv_10.42.42.10(pid=17015): Launched 11:56:56.531461 tst iperf3m4.py:8: start network... 11:56:56.753606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:57.261791 run create_hlr_db(pid=17016): Launched 11:56:57.388817 bus /gobi_6: Setting Powered False 11:56:58.453486 run create_hlr_db(pid=17016): Terminated: ok {rc=0} 11:56:58.908488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17018): Launched 11:56:59.237894 run osmo-hlr_10.42.42.2(pid=17019): Launched 11:56:59.364286 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:59.927066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17021): Launched 11:57:00.257104 run osmo-stp_10.42.42.5(pid=17022): Launched 11:57:00.381901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:00.957790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17024): Launched 11:57:01.094708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:01.383972 run patchelf(pid=17025): Launched 11:57:01.576017 run osmo-stp_10.42.42.5(pid=17022): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17022)] 11:57:01.712062 run osmo-stp_10.42.42.5(pid=17022): stdout: | (launched: 2022-12-13_11:57:00.196858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:01.849880 run osmo-stp_10.42.42.5(pid=17022): stderr: | 20221213115700387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115700387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115700388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115700388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115700389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115700389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115700389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:01.987081 run osmo-stp_10.42.42.5(pid=17022): stdout: | (launched: 2022-12-13_11:57:00.196858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:02.118632 run osmo-stp_10.42.42.5(pid=17022): stderr: | 20221213115700387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115700387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115700388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115700388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115700389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115700389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115700389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:02.273502 run patchelf(pid=17025): Terminating (SIGINT) 11:57:02.450441 run patchelf(pid=17025): Terminated: ok {rc=0} 11:57:02.577312 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17022): Process ended prematurely: osmo-stp_10.42.42.5(pid=17022) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17022)] [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 11:57:02.587284 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:57:02.615641 run osmo-hlr_10.42.42.2(pid=17019): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17019)] 11:57:02.665979 run osmo-hlr_10.42.42.2(pid=17019): stdout: | (launched: 2022-12-13_11:56:59.177861) 11:57:02.717693 run osmo-hlr_10.42.42.2(pid=17019): stderr: | 20221213115659375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115659375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115659375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115659375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115659375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115659375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115659389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115659397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115659397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115659397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:02.768566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17008): Terminating (SIGTERM) 11:57:02.810348 run iperf3-srv_10.42.42.10(pid=17009): Terminating (SIGTERM) 11:57:02.851726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17010): Terminating (SIGTERM) 11:57:02.893336 run iperf3-srv_10.42.42.10(pid=17011): Terminating (SIGTERM) 11:57:02.934646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17012): Terminating (SIGTERM) 11:57:02.976176 run iperf3-srv_10.42.42.10(pid=17013): Terminating (SIGTERM) 11:57:03.017362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17014): Terminating (SIGTERM) 11:57:03.059006 run iperf3-srv_10.42.42.10(pid=17015): Terminating (SIGTERM) 11:57:03.100257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17018): Terminating (SIGTERM) 11:57:03.141720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17021): Terminating (SIGTERM) 11:57:03.183717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17024): Terminating (SIGTERM) 11:57:03.225779 --- ParallelTerminationStrategy: PID 17008 died... 11:57:03.245659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17008): Terminated: ok {rc=0} 11:57:03.291193 --- ParallelTerminationStrategy: PID 17009 died... 11:57:03.311015 run iperf3-srv_10.42.42.10(pid=17009): Terminated {rc=256} 11:57:03.356260 --- ParallelTerminationStrategy: PID 17010 died... 11:57:03.376387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17010): Terminated: ok {rc=0} 11:57:03.422289 --- ParallelTerminationStrategy: PID 17011 died... 11:57:03.442100 run iperf3-srv_10.42.42.10(pid=17011): Terminated {rc=256} 11:57:03.487417 --- ParallelTerminationStrategy: PID 17012 died... 11:57:03.507144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17012): Terminated: ok {rc=0} 11:57:03.552424 --- ParallelTerminationStrategy: PID 17013 died... 11:57:03.572120 run iperf3-srv_10.42.42.10(pid=17013): Terminated {rc=256} 11:57:03.617531 --- ParallelTerminationStrategy: PID 17014 died... 11:57:03.637082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17014): Terminated: ok {rc=0} 11:57:03.682357 --- ParallelTerminationStrategy: PID 17015 died... 11:57:03.702002 run iperf3-srv_10.42.42.10(pid=17015): Terminated {rc=256} 11:57:03.747168 --- ParallelTerminationStrategy: PID 17018 died... 11:57:03.766739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17018): Terminated: ok {rc=0} 11:57:03.812022 --- ParallelTerminationStrategy: PID 17021 died... 11:57:03.831688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17021): Terminated: ok {rc=0} 11:57:03.876800 --- ParallelTerminationStrategy: PID 17024 died... 11:57:03.896815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17024): Terminated: ok {rc=0} 11:57:03.984742 bus /gobi_4: Setting Powered False 11:57:05.087336 bus /gobi_4: Setting Powered False 11:57:06.205042 bus /gobi_1: Setting Powered False 11:57:07.306774 bus /gobi_1: Setting Powered False 11:57:08.424183 bus /gobi_0: Setting Powered False 11:57:09.523309 bus /gobi_0: Setting Powered False 11:57:10.646516 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 11:57:11.750824 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:11.762952 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:57:11.817561 tst ping.py: using LAC 33780 11:57:11.945841 tst ping.py: using RAC 120 11:57:12.075196 tst ping.py: using CellId 33780 11:57:12.203589 tst ping.py: using BVCI 33781 11:57:12.323813 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:12.335339 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:12.346612 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:12.357925 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:12.369442 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:12.380849 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:12.392578 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:12.404164 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:57:12.524680 tst ping.py:19: start network... 11:57:12.744270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:13.247040 run create_hlr_db(pid=17026): Launched 11:57:13.370650 bus /gobi_6: Setting Powered False 11:57:14.431986 run create_hlr_db(pid=17026): Terminated: ok {rc=0} 11:57:14.887203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17028): Launched 11:57:15.214663 run osmo-hlr_10.42.42.2(pid=17029): Launched 11:57:15.341305 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:15.922730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17031): Launched 11:57:16.268082 run osmo-stp_10.42.42.5(pid=17032): Launched 11:57:16.437944 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:17.085968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17034): Launched 11:57:17.237809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:17.516921 run patchelf(pid=17035): Launched 11:57:17.699498 run osmo-stp_10.42.42.5(pid=17032): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17032)] 11:57:17.837461 run osmo-stp_10.42.42.5(pid=17032): stdout: | (launched: 2022-12-13_11:57:16.206791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:17.977075 run osmo-stp_10.42.42.5(pid=17032): stderr: | 20221213115716580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115716580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115716580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115716582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115716583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115716583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115716583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:18.116461 run osmo-stp_10.42.42.5(pid=17032): stdout: | (launched: 2022-12-13_11:57:16.206791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:18.250316 run osmo-stp_10.42.42.5(pid=17032): stderr: | 20221213115716580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115716580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115716580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115716582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115716583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115716583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115716583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:18.408352 run patchelf(pid=17035): Terminating (SIGINT) 11:57:18.589701 run patchelf(pid=17035): Terminated: ok {rc=0} 11:57:18.720750 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17032): Process ended prematurely: osmo-stp_10.42.42.5(pid=17032) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17032)] [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 11:57:18.730767 tst ping.py:22: Test FAILED (7.0 sec) 11:57:18.759222 run osmo-hlr_10.42.42.2(pid=17029): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17029)] 11:57:18.811147 run osmo-hlr_10.42.42.2(pid=17029): stdout: | (launched: 2022-12-13_11:57:15.154686) 11:57:18.864171 run osmo-hlr_10.42.42.2(pid=17029): stderr: | 20221213115715351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115715351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115715351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115715351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115715351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115715351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115715364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115715373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115715373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115715373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:18.917785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17028): Terminating (SIGTERM) 11:57:18.960406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17031): Terminating (SIGTERM) 11:57:19.003309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17034): Terminating (SIGTERM) 11:57:19.046597 --- ParallelTerminationStrategy: PID 17028 died... 11:57:19.067560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17028): Terminated: ok {rc=0} 11:57:19.115386 --- ParallelTerminationStrategy: PID 17031 died... 11:57:19.135676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17031): Terminated: ok {rc=0} 11:57:19.183239 --- ParallelTerminationStrategy: PID 17034 died... 11:57:19.203398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17034): Terminated: ok {rc=0} 11:57:19.294107 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:57:20.382331 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:20.395334 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:57:20.450304 tst ping_idle_ping.py: using LAC 33781 11:57:20.581904 tst ping_idle_ping.py: using RAC 121 11:57:20.709439 tst ping_idle_ping.py: using CellId 33781 11:57:20.837064 tst ping_idle_ping.py: using BVCI 33782 11:57:20.955576 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:20.967142 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:20.978442 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:20.989725 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:21.001320 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:21.012725 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:21.024449 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:57:21.036026 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:57:21.158497 tst ping_idle_ping.py:24: start network... 11:57:21.379921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:21.886939 run create_hlr_db(pid=17036): Launched 11:57:22.013043 bus /gobi_6: Setting Powered False 11:57:23.078391 run create_hlr_db(pid=17036): Terminated: ok {rc=0} 11:57:23.515201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17038): Launched 11:57:23.821697 run osmo-hlr_10.42.42.2(pid=17039): Launched 11:57:23.937861 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:24.481404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17041): Launched 11:57:24.786847 run osmo-stp_10.42.42.5(pid=17042): Launched 11:57:24.903774 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:25.463503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17044): Launched 11:57:25.591907 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:25.867858 run patchelf(pid=17045): Launched 11:57:26.051516 run osmo-stp_10.42.42.5(pid=17042): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17042)] 11:57:26.191122 run osmo-stp_10.42.42.5(pid=17042): stdout: | (launched: 2022-12-13_11:57:24.730557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:26.331744 run osmo-stp_10.42.42.5(pid=17042): stderr: | 20221213115724899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115724899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115724899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115724899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115724900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115724900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115724900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:26.472108 run osmo-stp_10.42.42.5(pid=17042): stdout: | (launched: 2022-12-13_11:57:24.730557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:26.606242 run osmo-stp_10.42.42.5(pid=17042): stderr: | 20221213115724899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115724899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115724899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115724899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115724900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115724900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115724900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:26.764698 run patchelf(pid=17045): Terminating (SIGINT) 11:57:26.947591 run patchelf(pid=17045): Terminated: ok {rc=0} 11:57:27.079327 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17042): Process ended prematurely: osmo-stp_10.42.42.5(pid=17042) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17042)] [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 11:57:27.089111 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:57:27.117598 run osmo-hlr_10.42.42.2(pid=17039): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17039)] 11:57:27.168746 run osmo-hlr_10.42.42.2(pid=17039): stdout: | (launched: 2022-12-13_11:57:23.765346) 11:57:27.221899 run osmo-hlr_10.42.42.2(pid=17039): stderr: | 20221213115723939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115723939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115723939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115723939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115723939 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115723939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115723951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115723962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115723962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115723962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:27.275041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17038): Terminating (SIGTERM) 11:57:27.317363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17041): Terminating (SIGTERM) 11:57:27.360043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17044): Terminating (SIGTERM) 11:57:27.403257 --- ParallelTerminationStrategy: PID 17038 died... 11:57:27.424216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17038): Terminated: ok {rc=0} 11:57:27.471660 --- ParallelTerminationStrategy: PID 17041 died... 11:57:27.492011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17041): Terminated: ok {rc=0} 11:57:27.539096 --- ParallelTerminationStrategy: PID 17044 died... 11:57:27.559410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17044): Terminated: ok {rc=0} 11:57:27.651207 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:57:28.965605 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:57:28.972117 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:57:29.005896 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:57:29.044528 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:57:29.133320 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:57:29.167119 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:57:29.205782 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:57:29.799862 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:57:29.849655 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:29.860500 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:57:29.930541 tst cs_paging_gprs_active.py: using LAC 33782 11:57:30.053129 tst cs_paging_gprs_active.py: using RAC 122 11:57:30.176719 tst cs_paging_gprs_active.py: using CellId 33782 11:57:30.297999 tst cs_paging_gprs_active.py: using BVCI 33783 11:57:30.412461 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:30.423383 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:30.434133 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:30.444795 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:30.455427 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:30.466189 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:30.477039 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:30.487565 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:30.498379 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:57:30.619458 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:57:30.738307 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:57:30.961549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:31.306127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17049): Launched 11:57:31.641619 run iperf3-srv_10.42.42.10(pid=17050): Launched 11:57:31.810620 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:57:32.092479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:32.452332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17051): Launched 11:57:32.723092 run iperf3-srv_10.42.42.10(pid=17052): Launched 11:57:32.839302 tst cs_paging_gprs_active.py:38: start network... 11:57:33.047364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:33.527617 run create_hlr_db(pid=17053): Launched 11:57:33.655072 bus /gobi_6: Setting Powered False 11:57:34.716085 run create_hlr_db(pid=17053): Terminated: ok {rc=0} 11:57:35.169468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17055): Launched 11:57:35.503811 run osmo-hlr_10.42.42.2(pid=17056): Launched 11:57:35.631714 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:36.206059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17058): Launched 11:57:36.539155 run osmo-stp_10.42.42.5(pid=17059): Launched 11:57:36.668520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:37.241390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17061): Launched 11:57:37.370984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:37.652129 run patchelf(pid=17062): Launched 11:57:37.839351 run osmo-stp_10.42.42.5(pid=17059): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17059)] 11:57:37.980191 run osmo-stp_10.42.42.5(pid=17059): stdout: | (launched: 2022-12-13_11:57:36.478576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:38.123138 run osmo-stp_10.42.42.5(pid=17059): stderr: | 20221213115736671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115736671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115736671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115736672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115736672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115736672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115736673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:38.266465 run osmo-stp_10.42.42.5(pid=17059): stdout: | (launched: 2022-12-13_11:57:36.478576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:38.402736 run osmo-stp_10.42.42.5(pid=17059): stderr: | 20221213115736671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115736671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115736671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115736672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115736672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115736672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115736673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:38.564257 run patchelf(pid=17062): Terminating (SIGINT) 11:57:38.750506 run patchelf(pid=17062): Terminated: ok {rc=0} 11:57:38.884791 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17059): Process ended prematurely: osmo-stp_10.42.42.5(pid=17059) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17059)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:57:38.895193 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 11:57:38.923765 run osmo-hlr_10.42.42.2(pid=17056): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17056)] 11:57:38.974924 run osmo-hlr_10.42.42.2(pid=17056): stdout: | (launched: 2022-12-13_11:57:35.443480) 11:57:39.027504 run osmo-hlr_10.42.42.2(pid=17056): stderr: | 20221213115735643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115735643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115735643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115735643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115735643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115735643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115735655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115735665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115735665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115735665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:39.080500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17049): Terminating (SIGTERM) 11:57:39.122851 run iperf3-srv_10.42.42.10(pid=17050): Terminating (SIGTERM) 11:57:39.165584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17051): Terminating (SIGTERM) 11:57:39.208543 run iperf3-srv_10.42.42.10(pid=17052): Terminating (SIGTERM) 11:57:39.251213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17055): Terminating (SIGTERM) 11:57:39.293835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17058): Terminating (SIGTERM) 11:57:39.336389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17061): Terminating (SIGTERM) 11:57:39.379219 --- ParallelTerminationStrategy: PID 17049 died... 11:57:39.399942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17049): Terminated: ok {rc=0} 11:57:39.447154 --- ParallelTerminationStrategy: PID 17050 died... 11:57:39.467164 run iperf3-srv_10.42.42.10(pid=17050): Terminated {rc=256} 11:57:39.513874 --- ParallelTerminationStrategy: PID 17051 died... 11:57:39.534070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17051): Terminated: ok {rc=0} 11:57:39.580554 --- ParallelTerminationStrategy: PID 17052 died... 11:57:39.600627 run iperf3-srv_10.42.42.10(pid=17052): Terminated {rc=256} 11:57:39.647142 --- ParallelTerminationStrategy: PID 17055 died... 11:57:39.667193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17055): Terminated: ok {rc=0} 11:57:39.713685 --- ParallelTerminationStrategy: PID 17058 died... 11:57:39.733689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17058): Terminated: ok {rc=0} 11:57:39.780040 --- ParallelTerminationStrategy: PID 17061 died... 11:57:39.799988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17061): Terminated: ok {rc=0} 11:57:39.888773 bus /gobi_0: Setting Powered False 11:57:40.987661 bus /gobi_0: Setting Powered False 11:57:42.105290 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:57:43.255925 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:43.268197 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:57:43.344674 tst iperf3.py: using LAC 33783 11:57:43.474225 tst iperf3.py: using RAC 123 11:57:43.603980 tst iperf3.py: using CellId 33783 11:57:43.727506 tst iperf3.py: using BVCI 33784 11:57:43.841584 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:43.852631 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:43.863599 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:43.874724 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:43.886278 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:43.897488 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:43.908573 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:43.919577 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:43.930852 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:57:44.050564 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:57:44.275900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:44.608488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17063): Launched 11:57:44.898714 run iperf3-srv_10.42.42.10(pid=17064): Launched 11:57:45.024515 tst iperf3.py:8: start network... 11:57:45.250028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:45.761759 run create_hlr_db(pid=17065): Launched 11:57:45.908647 bus /gobi_6: Setting Powered False 11:57:46.991580 run create_hlr_db(pid=17065): Terminated: ok {rc=0} 11:57:47.523509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17067): Launched 11:57:47.857149 run osmo-hlr_10.42.42.2(pid=17068): Launched 11:57:47.982905 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:48.554729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17070): Launched 11:57:48.887430 run osmo-stp_10.42.42.5(pid=17071): Launched 11:57:49.013376 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:49.584621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17073): Launched 11:57:49.712420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:49.993105 run patchelf(pid=17074): Launched 11:57:50.179662 run osmo-stp_10.42.42.5(pid=17071): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17071)] 11:57:50.320895 run osmo-stp_10.42.42.5(pid=17071): stdout: | (launched: 2022-12-13_11:57:48.827440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:50.463282 run osmo-stp_10.42.42.5(pid=17071): stderr: | 20221213115749019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115749019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115749020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115749020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115749021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115749021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115749021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:50.605486 run osmo-stp_10.42.42.5(pid=17071): stdout: | (launched: 2022-12-13_11:57:48.827440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:50.741275 run osmo-stp_10.42.42.5(pid=17071): stderr: | 20221213115749019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115749019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115749020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115749020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115749021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115749021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115749021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:50.902609 run patchelf(pid=17074): Terminating (SIGINT) 11:57:51.087846 run patchelf(pid=17074): Terminated: ok {rc=0} 11:57:51.222265 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17071): Process ended prematurely: osmo-stp_10.42.42.5(pid=17071) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17071)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 11:57:51.232608 tst iperf3.py:8: Test FAILED (8.0 sec) 11:57:51.261789 run osmo-hlr_10.42.42.2(pid=17068): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17068)] 11:57:51.313275 run osmo-hlr_10.42.42.2(pid=17068): stdout: | (launched: 2022-12-13_11:57:47.796617) 11:57:51.365718 run osmo-hlr_10.42.42.2(pid=17068): stderr: | 20221213115747995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115747995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115747995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115747995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115747995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115747995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115748008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115748017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115748017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115748017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:51.418623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17063): Terminating (SIGTERM) 11:57:51.460788 run iperf3-srv_10.42.42.10(pid=17064): Terminating (SIGTERM) 11:57:51.503393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17067): Terminating (SIGTERM) 11:57:51.546339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17070): Terminating (SIGTERM) 11:57:51.589156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17073): Terminating (SIGTERM) 11:57:51.632130 --- ParallelTerminationStrategy: PID 17063 died... 11:57:51.652849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17063): Terminated: ok {rc=0} 11:57:51.700291 --- ParallelTerminationStrategy: PID 17064 died... 11:57:51.720531 run iperf3-srv_10.42.42.10(pid=17064): Terminated {rc=256} 11:57:51.767763 --- ParallelTerminationStrategy: PID 17067 died... 11:57:51.788228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17067): Terminated: ok {rc=0} 11:57:51.835297 --- ParallelTerminationStrategy: PID 17070 died... 11:57:51.855552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17070): Terminated: ok {rc=0} 11:57:51.902974 --- ParallelTerminationStrategy: PID 17073 died... 11:57:51.923212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17073): Terminated: ok {rc=0} 11:57:52.012185 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:57:53.165832 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:53.178390 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:57:53.254129 tst iperf3m4.py: using LAC 33784 11:57:53.381769 tst iperf3m4.py: using RAC 124 11:57:53.502880 tst iperf3m4.py: using CellId 33784 11:57:53.624122 tst iperf3m4.py: using BVCI 33785 11:57:53.737223 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:53.748370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:53.759516 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:53.770660 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:53.781727 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:53.792844 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:53.804029 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:53.815049 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:57:53.826109 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:57:53.947505 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:57:54.074573 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:57:54.194659 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:57:54.317628 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:57:54.542825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:54.876851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17075): Launched 11:57:55.166556 run iperf3-srv_10.42.42.10(pid=17076): Launched 11:57:55.293521 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:57:55.519122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:55.853675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17077): Launched 11:57:56.145717 run iperf3-srv_10.42.42.10(pid=17078): Launched 11:57:56.271674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:57:56.497067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:56.831917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17079): Launched 11:57:57.122192 run iperf3-srv_10.42.42.10(pid=17080): Launched 11:57:57.248585 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:57:57.473179 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:57.806860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17081): Launched 11:57:58.096089 run iperf3-srv_10.42.42.10(pid=17082): Launched 11:57:58.222936 tst iperf3m4.py:8: start network... 11:57:58.447681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:58.935826 run create_hlr_db(pid=17083): Launched 11:57:59.062627 bus /gobi_6: Setting Powered False 11:58:00.125158 run create_hlr_db(pid=17083): Terminated: ok {rc=0} 11:58:00.557451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17085): Launched 11:58:00.894195 run osmo-hlr_10.42.42.2(pid=17086): Launched 11:58:01.138235 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:01.849756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17088): Launched 11:58:02.179565 run osmo-stp_10.42.42.5(pid=17089): Launched 11:58:02.400095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:02.983670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17091): Launched 11:58:03.113303 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:03.395094 run patchelf(pid=17092): Launched 11:58:03.581089 run osmo-stp_10.42.42.5(pid=17089): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17089)] 11:58:03.722059 run osmo-stp_10.42.42.5(pid=17089): stdout: | (launched: 2022-12-13_11:58:02.120020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:03.864417 run osmo-stp_10.42.42.5(pid=17089): stderr: | 20221213115802403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115802403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115802404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115802404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115802405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115802405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115802405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:04.006808 run osmo-stp_10.42.42.5(pid=17089): stdout: | (launched: 2022-12-13_11:58:02.120020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:04.142511 run osmo-stp_10.42.42.5(pid=17089): stderr: | 20221213115802403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115802403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115802404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115802404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115802405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115802405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115802405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:04.303745 run patchelf(pid=17092): Terminating (SIGINT) 11:58:04.489228 run patchelf(pid=17092): Terminated: ok {rc=0} 11:58:04.623490 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17089): Process ended prematurely: osmo-stp_10.42.42.5(pid=17089) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17089)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:58:04.633970 tst iperf3m4.py:8: Test FAILED (11.5 sec) 11:58:04.663263 run osmo-hlr_10.42.42.2(pid=17086): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17086)] 11:58:04.714900 run osmo-hlr_10.42.42.2(pid=17086): stdout: | (launched: 2022-12-13_11:58:00.812502) 11:58:04.767495 run osmo-hlr_10.42.42.2(pid=17086): stderr: | 20221213115801203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115801203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115801203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115801203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115801203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115801203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115801253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115801262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115801262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115801262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:04.820480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17075): Terminating (SIGTERM) 11:58:04.862722 run iperf3-srv_10.42.42.10(pid=17076): Terminating (SIGTERM) 11:58:04.905368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17077): Terminating (SIGTERM) 11:58:04.948150 run iperf3-srv_10.42.42.10(pid=17078): Terminating (SIGTERM) 11:58:04.990891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17079): Terminating (SIGTERM) 11:58:05.033699 run iperf3-srv_10.42.42.10(pid=17080): Terminating (SIGTERM) 11:58:05.076296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17081): Terminating (SIGTERM) 11:58:05.119391 run iperf3-srv_10.42.42.10(pid=17082): Terminating (SIGTERM) 11:58:05.161887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17085): Terminating (SIGTERM) 11:58:05.204718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17088): Terminating (SIGTERM) 11:58:05.247431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17091): Terminating (SIGTERM) 11:58:05.290417 --- ParallelTerminationStrategy: PID 17075 died... 11:58:05.311294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17075): Terminated: ok {rc=0} 11:58:05.358923 --- ParallelTerminationStrategy: PID 17076 died... 11:58:05.379220 run iperf3-srv_10.42.42.10(pid=17076): Terminated {rc=256} 11:58:05.426347 --- ParallelTerminationStrategy: PID 17077 died... 11:58:05.446511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17077): Terminated: ok {rc=0} 11:58:05.493702 --- ParallelTerminationStrategy: PID 17078 died... 11:58:05.513982 run iperf3-srv_10.42.42.10(pid=17078): Terminated {rc=256} 11:58:05.561182 --- ParallelTerminationStrategy: PID 17079 died... 11:58:05.581499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17079): Terminated: ok {rc=0} 11:58:05.628688 --- ParallelTerminationStrategy: PID 17080 died... 11:58:05.648813 run iperf3-srv_10.42.42.10(pid=17080): Terminated {rc=256} 11:58:05.695877 --- ParallelTerminationStrategy: PID 17081 died... 11:58:05.715908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17081): Terminated: ok {rc=0} 11:58:05.763454 --- ParallelTerminationStrategy: PID 17082 died... 11:58:05.783743 run iperf3-srv_10.42.42.10(pid=17082): Terminated {rc=256} 11:58:05.831524 --- ParallelTerminationStrategy: PID 17085 died... 11:58:05.851867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17085): Terminated: ok {rc=0} 11:58:05.899128 --- ParallelTerminationStrategy: PID 17088 died... 11:58:05.919358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17088): Terminated: ok {rc=0} 11:58:05.966018 --- ParallelTerminationStrategy: PID 17091 died... 11:58:05.986168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17091): Terminated: ok {rc=0} 11:58:06.074484 bus /gobi_4: Setting Powered False 11:58:07.173801 bus /gobi_4: Setting Powered False 11:58:08.290948 bus /gobi_1: Setting Powered False 11:58:09.389858 bus /gobi_1: Setting Powered False 11:58:10.509869 bus /gobi_0: Setting Powered False 11:58:11.607985 bus /gobi_0: Setting Powered False 11:58:12.723487 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:58:13.827671 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:13.839570 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:58:13.911711 tst ping.py: using LAC 33785 11:58:14.032062 tst ping.py: using RAC 125 11:58:14.155217 tst ping.py: using CellId 33785 11:58:14.274088 tst ping.py: using BVCI 33786 11:58:14.383813 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:14.395040 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:14.405927 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:14.416889 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:14.427646 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:14.438490 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:14.449446 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:14.460367 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:58:14.579302 tst ping.py:19: start network... 11:58:14.799463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:15.303383 run create_hlr_db(pid=17093): Launched 11:58:15.428752 bus /gobi_6: Setting Powered False 11:58:16.490125 run create_hlr_db(pid=17093): Terminated: ok {rc=0} 11:58:16.932604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17095): Launched 11:58:17.256529 run osmo-hlr_10.42.42.2(pid=17096): Launched 11:58:17.374632 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:17.919634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17098): Launched 11:58:18.225517 run osmo-stp_10.42.42.5(pid=17099): Launched 11:58:18.342471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:18.874324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17101): Launched 11:58:18.992860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:19.249341 run patchelf(pid=17102): Launched 11:58:19.418542 run osmo-stp_10.42.42.5(pid=17099): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17099)] 11:58:19.547274 run osmo-stp_10.42.42.5(pid=17099): stdout: | (launched: 2022-12-13_11:58:18.169360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:19.677707 run osmo-stp_10.42.42.5(pid=17099): stderr: | 20221213115818338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115818338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115818339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115818339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115818339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115818339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115818340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:19.807955 run osmo-stp_10.42.42.5(pid=17099): stdout: | (launched: 2022-12-13_11:58:18.169360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:19.932044 run osmo-stp_10.42.42.5(pid=17099): stderr: | 20221213115818338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115818338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115818339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115818339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115818339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115818339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115818340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:20.079913 run patchelf(pid=17102): Terminating (SIGINT) 11:58:20.249896 run patchelf(pid=17102): Terminated: ok {rc=0} 11:58:20.371996 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17099): Process ended prematurely: osmo-stp_10.42.42.5(pid=17099) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17099)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 11:58:20.381034 tst ping.py:22: Test FAILED (6.5 sec) 11:58:20.408361 run osmo-hlr_10.42.42.2(pid=17096): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17096)] 11:58:20.456105 run osmo-hlr_10.42.42.2(pid=17096): stdout: | (launched: 2022-12-13_11:58:17.199717) 11:58:20.506217 run osmo-hlr_10.42.42.2(pid=17096): stderr: | 20221213115817375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115817375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115817375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115817375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115817375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115817375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115817388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115817396 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115817396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115817396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:20.556276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17095): Terminating (SIGTERM) 11:58:20.595851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17098): Terminating (SIGTERM) 11:58:20.635542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17101): Terminating (SIGTERM) 11:58:20.675599 --- ParallelTerminationStrategy: PID 17095 died... 11:58:20.695010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17095): Terminated: ok {rc=0} 11:58:20.739230 --- ParallelTerminationStrategy: PID 17098 died... 11:58:20.758101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17098): Terminated: ok {rc=0} 11:58:20.801918 --- ParallelTerminationStrategy: PID 17101 died... 11:58:20.820660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17101): Terminated: ok {rc=0} 11:58:20.904725 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:58:21.990400 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:22.002421 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:58:22.076903 tst ping_idle_ping.py: using LAC 33786 11:58:22.198241 tst ping_idle_ping.py: using RAC 126 11:58:22.321008 tst ping_idle_ping.py: using CellId 33786 11:58:22.442400 tst ping_idle_ping.py: using BVCI 33787 11:58:22.554780 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:22.566001 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:22.576850 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:22.587851 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:22.599206 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:22.610972 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:22.622474 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:58:22.633894 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:58:22.754158 tst ping_idle_ping.py:24: start network... 11:58:22.976021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:23.490022 run create_hlr_db(pid=17103): Launched 11:58:23.616851 bus /gobi_6: Setting Powered False 11:58:24.681658 run create_hlr_db(pid=17103): Terminated: ok {rc=0} 11:58:25.135669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17105): Launched 11:58:25.462490 run osmo-hlr_10.42.42.2(pid=17106): Launched 11:58:25.587217 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:26.151827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17108): Launched 11:58:26.480248 run osmo-stp_10.42.42.5(pid=17109): Launched 11:58:26.605395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:27.166639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17111): Launched 11:58:27.292274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:27.567284 run patchelf(pid=17112): Launched 11:58:27.750614 run osmo-stp_10.42.42.5(pid=17109): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17109)] 11:58:27.888475 run osmo-stp_10.42.42.5(pid=17109): stdout: | (launched: 2022-12-13_11:58:26.420761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:28.028176 run osmo-stp_10.42.42.5(pid=17109): stderr: | 20221213115826613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115826613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115826613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115826614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115826614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115826614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115826614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:28.168143 run osmo-stp_10.42.42.5(pid=17109): stdout: | (launched: 2022-12-13_11:58:26.420761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:28.302426 run osmo-stp_10.42.42.5(pid=17109): stderr: | 20221213115826613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115826613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115826613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115826614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115826614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115826614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115826614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:28.460630 run patchelf(pid=17112): Terminating (SIGINT) 11:58:28.642327 run patchelf(pid=17112): Terminated: ok {rc=0} 11:58:28.773362 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17109): Process ended prematurely: osmo-stp_10.42.42.5(pid=17109) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17109)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:58:28.783104 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:58:28.811348 run osmo-hlr_10.42.42.2(pid=17106): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17106)] 11:58:28.862632 run osmo-hlr_10.42.42.2(pid=17106): stdout: | (launched: 2022-12-13_11:58:25.403207) 11:58:28.915597 run osmo-hlr_10.42.42.2(pid=17106): stderr: | 20221213115825600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115825600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115825601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115825601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115825601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115825601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115825613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115825622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115825622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115825622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:28.968322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17105): Terminating (SIGTERM) 11:58:29.010335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17108): Terminating (SIGTERM) 11:58:29.052582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17111): Terminating (SIGTERM) 11:58:29.095093 --- ParallelTerminationStrategy: PID 17105 died... 11:58:29.115825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17105): Terminated: ok {rc=0} 11:58:29.163003 --- ParallelTerminationStrategy: PID 17108 died... 11:58:29.182929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17108): Terminated: ok {rc=0} 11:58:29.229668 --- ParallelTerminationStrategy: PID 17111 died... 11:58:29.249521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17111): Terminated: ok {rc=0} 11:58:29.338501 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:58:30.662528 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:58:30.670245 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:58:30.706441 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:58:30.747908 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:58:30.846254 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:58:30.881279 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:58:30.929465 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:58:31.507651 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:58:31.579076 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:31.593766 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:58:31.679378 tst cs_paging_gprs_active.py: using LAC 33787 11:58:31.842058 tst cs_paging_gprs_active.py: using RAC 127 11:58:32.005349 tst cs_paging_gprs_active.py: using CellId 33787 11:58:32.134848 tst cs_paging_gprs_active.py: using BVCI 33788 11:58:32.262188 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:32.274685 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:32.287025 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:32.299386 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:32.312720 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:32.326463 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:32.340751 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:32.354541 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:32.367777 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:58:32.485991 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:58:32.608601 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:58:32.834091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:33.169095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17118): Launched 11:58:33.460513 run iperf3-srv_10.42.42.10(pid=17119): Launched 11:58:33.585875 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:58:33.810498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:34.145253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17120): Launched 11:58:34.436032 run iperf3-srv_10.42.42.10(pid=17121): Launched 11:58:34.561891 tst cs_paging_gprs_active.py:38: start network... 11:58:34.786297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:35.302657 run create_hlr_db(pid=17122): Launched 11:58:35.432257 bus /gobi_6: Setting Powered False 11:58:36.497089 run create_hlr_db(pid=17122): Terminated: ok {rc=0} 11:58:36.959728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17124): Launched 11:58:37.294898 run osmo-hlr_10.42.42.2(pid=17125): Launched 11:58:37.423497 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:37.993673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17127): Launched 11:58:38.327539 run osmo-stp_10.42.42.5(pid=17128): Launched 11:58:38.455871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:39.027632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17130): Launched 11:58:39.156604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:39.438271 run patchelf(pid=17131): Launched 11:58:39.624206 run osmo-stp_10.42.42.5(pid=17128): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17128)] 11:58:39.764605 run osmo-stp_10.42.42.5(pid=17128): stdout: | (launched: 2022-12-13_11:58:38.267001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:39.907459 run osmo-stp_10.42.42.5(pid=17128): stderr: | 20221213115838458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115838458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115838458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115838459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115838459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115838459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115838459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:40.050406 run osmo-stp_10.42.42.5(pid=17128): stdout: | (launched: 2022-12-13_11:58:38.267001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:40.186833 run osmo-stp_10.42.42.5(pid=17128): stderr: | 20221213115838458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115838458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115838458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115838459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115838459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115838459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115838459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:40.348749 run patchelf(pid=17131): Terminating (SIGINT) 11:58:40.535309 run patchelf(pid=17131): Terminated: ok {rc=0} 11:58:40.669619 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17128): Process ended prematurely: osmo-stp_10.42.42.5(pid=17128) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17128)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:58:40.680096 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 11:58:40.709104 run osmo-hlr_10.42.42.2(pid=17125): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17125)] 11:58:40.760851 run osmo-hlr_10.42.42.2(pid=17125): stdout: | (launched: 2022-12-13_11:58:37.234438) 11:58:40.813553 run osmo-hlr_10.42.42.2(pid=17125): stderr: | 20221213115837432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115837432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115837432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115837432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115837432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115837433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115837448 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115837456 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115837456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115837456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:40.866425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17118): Terminating (SIGTERM) 11:58:40.908659 run iperf3-srv_10.42.42.10(pid=17119): Terminating (SIGTERM) 11:58:40.950872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17120): Terminating (SIGTERM) 11:58:40.993182 run iperf3-srv_10.42.42.10(pid=17121): Terminating (SIGTERM) 11:58:41.035360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17124): Terminating (SIGTERM) 11:58:41.077664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17127): Terminating (SIGTERM) 11:58:41.120094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17130): Terminating (SIGTERM) 11:58:41.162568 --- ParallelTerminationStrategy: PID 17118 died... 11:58:41.183097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17118): Terminated: ok {rc=0} 11:58:41.230312 --- ParallelTerminationStrategy: PID 17119 died... 11:58:41.250259 run iperf3-srv_10.42.42.10(pid=17119): Terminated {rc=256} 11:58:41.296815 --- ParallelTerminationStrategy: PID 17120 died... 11:58:41.317212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17120): Terminated: ok {rc=0} 11:58:41.363911 --- ParallelTerminationStrategy: PID 17121 died... 11:58:41.383814 run iperf3-srv_10.42.42.10(pid=17121): Terminated {rc=256} 11:58:41.430319 --- ParallelTerminationStrategy: PID 17124 died... 11:58:41.450275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17124): Terminated: ok {rc=0} 11:58:41.497469 --- ParallelTerminationStrategy: PID 17127 died... 11:58:41.517606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17127): Terminated: ok {rc=0} 11:58:41.564616 --- ParallelTerminationStrategy: PID 17130 died... 11:58:41.584775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17130): Terminated: ok {rc=0} 11:58:41.674118 bus /gobi_0: Setting Powered False 11:58:42.775376 bus /gobi_0: Setting Powered False 11:58:43.892843 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:58:45.044912 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:45.057310 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:58:45.134379 tst iperf3.py: using LAC 33788 11:58:45.265934 tst iperf3.py: using RAC 128 11:58:45.397939 tst iperf3.py: using CellId 33788 11:58:45.529472 tst iperf3.py: using BVCI 33789 11:58:45.642549 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:45.653775 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:45.664721 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:45.675740 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:45.686432 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:45.697531 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:45.708417 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:45.719111 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:45.730066 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:58:45.843553 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:58:46.085454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:46.403284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17132): Launched 11:58:46.691015 run iperf3-srv_10.42.42.10(pid=17133): Launched 11:58:46.824771 tst iperf3.py:8: start network... 11:58:47.037402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:47.519344 run create_hlr_db(pid=17134): Launched 11:58:47.646294 bus /gobi_6: Setting Powered False 11:58:48.707377 run create_hlr_db(pid=17134): Terminated: ok {rc=0} 11:58:49.159401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17136): Launched 11:58:49.493307 run osmo-hlr_10.42.42.2(pid=17137): Launched 11:58:49.622620 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:50.195081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17139): Launched 11:58:50.527899 run osmo-stp_10.42.42.5(pid=17140): Launched 11:58:50.654745 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:51.225802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17142): Launched 11:58:51.353993 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:51.636077 run patchelf(pid=17143): Launched 11:58:51.823058 run osmo-stp_10.42.42.5(pid=17140): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17140)] 11:58:51.963889 run osmo-stp_10.42.42.5(pid=17140): stdout: | (launched: 2022-12-13_11:58:50.467502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:52.105823 run osmo-stp_10.42.42.5(pid=17140): stderr: | 20221213115850660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115850660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115850660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115850661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115850661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115850661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115850661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:52.248702 run osmo-stp_10.42.42.5(pid=17140): stdout: | (launched: 2022-12-13_11:58:50.467502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:52.384554 run osmo-stp_10.42.42.5(pid=17140): stderr: | 20221213115850660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115850660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115850660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115850661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115850661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115850661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115850661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:52.545505 run patchelf(pid=17143): Terminating (SIGINT) 11:58:52.730382 run patchelf(pid=17143): Terminated: ok {rc=0} 11:58:52.863988 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17140): Process ended prematurely: osmo-stp_10.42.42.5(pid=17140) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17140)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 11:58:52.874438 tst iperf3.py:8: Test FAILED (7.9 sec) 11:58:52.903416 run osmo-hlr_10.42.42.2(pid=17137): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17137)] 11:58:52.955080 run osmo-hlr_10.42.42.2(pid=17137): stdout: | (launched: 2022-12-13_11:58:49.433139) 11:58:53.007409 run osmo-hlr_10.42.42.2(pid=17137): stderr: | 20221213115849631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115849631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115849631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115849631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115849631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115849631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115849643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115849652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115849652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115849652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:53.060322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17132): Terminating (SIGTERM) 11:58:53.102605 run iperf3-srv_10.42.42.10(pid=17133): Terminating (SIGTERM) 11:58:53.145300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17136): Terminating (SIGTERM) 11:58:53.188082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17139): Terminating (SIGTERM) 11:58:53.231393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17142): Terminating (SIGTERM) 11:58:53.274377 --- ParallelTerminationStrategy: PID 17132 died... 11:58:53.294972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17132): Terminated: ok {rc=0} 11:58:53.342308 --- ParallelTerminationStrategy: PID 17133 died... 11:58:53.362266 run iperf3-srv_10.42.42.10(pid=17133): Terminated {rc=256} 11:58:53.409198 --- ParallelTerminationStrategy: PID 17136 died... 11:58:53.429284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17136): Terminated: ok {rc=0} 11:58:53.476076 --- ParallelTerminationStrategy: PID 17139 died... 11:58:53.496256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17139): Terminated: ok {rc=0} 11:58:53.543106 --- ParallelTerminationStrategy: PID 17142 died... 11:58:53.563154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17142): Terminated: ok {rc=0} 11:58:53.652458 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:58:54.806750 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:54.818982 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:58:54.893299 tst iperf3m4.py: using LAC 33789 11:58:55.023783 tst iperf3m4.py: using RAC 129 11:58:55.153339 tst iperf3m4.py: using CellId 33789 11:58:55.285095 tst iperf3m4.py: using BVCI 33790 11:58:55.406382 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:55.417939 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:55.429305 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:55.440506 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:55.452110 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:55.463751 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:55.475462 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:55.487004 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:58:55.498907 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:58:55.619893 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:58:55.744870 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:58:55.867413 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:58:55.988196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:58:56.214446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:56.549410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17145): Launched 11:58:56.840107 run iperf3-srv_10.42.42.10(pid=17146): Launched 11:58:56.964892 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:58:57.190058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:57.523906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17147): Launched 11:58:57.813353 run iperf3-srv_10.42.42.10(pid=17148): Launched 11:58:57.939381 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:58:58.164454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:58.499406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17149): Launched 11:58:58.790447 run iperf3-srv_10.42.42.10(pid=17150): Launched 11:58:58.915878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:58:59.140657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:59.474161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17151): Launched 11:58:59.763022 run iperf3-srv_10.42.42.10(pid=17152): Launched 11:58:59.888698 tst iperf3m4.py:8: start network... 11:59:00.112940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:00.626502 run create_hlr_db(pid=17153): Launched 11:59:00.756175 bus /gobi_6: Setting Powered False 11:59:01.838473 run create_hlr_db(pid=17153): Terminated: ok {rc=0} 11:59:02.363342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17155): Launched 11:59:02.696768 run osmo-hlr_10.42.42.2(pid=17156): Launched 11:59:02.823803 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:03.396831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17158): Launched 11:59:03.729482 run osmo-stp_10.42.42.5(pid=17159): Launched 11:59:03.858258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:04.431567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17161): Launched 11:59:04.559616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:04.839610 run patchelf(pid=17162): Launched 11:59:05.025242 run osmo-stp_10.42.42.5(pid=17159): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17159)] 11:59:05.166252 run osmo-stp_10.42.42.5(pid=17159): stdout: | (launched: 2022-12-13_11:59:03.668837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:05.309129 run osmo-stp_10.42.42.5(pid=17159): stderr: | 20221213115903857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115903858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115903858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115903858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115903859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115903859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115903859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:05.451903 run osmo-stp_10.42.42.5(pid=17159): stdout: | (launched: 2022-12-13_11:59:03.668837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:05.587923 run osmo-stp_10.42.42.5(pid=17159): stderr: | 20221213115903857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115903858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115903858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115903858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115903859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115903859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115903859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:05.749394 run patchelf(pid=17162): Terminating (SIGINT) 11:59:05.934942 run patchelf(pid=17162): Terminated: ok {rc=0} 11:59:06.068779 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17159): Process ended prematurely: osmo-stp_10.42.42.5(pid=17159) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17159)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:59:06.079222 tst iperf3m4.py:8: Test FAILED (11.3 sec) 11:59:06.108249 run osmo-hlr_10.42.42.2(pid=17156): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17156)] 11:59:06.159119 run osmo-hlr_10.42.42.2(pid=17156): stdout: | (launched: 2022-12-13_11:59:02.636161) 11:59:06.211758 run osmo-hlr_10.42.42.2(pid=17156): stderr: | 20221213115902833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115902833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115902833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115902833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115902833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115902833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115902846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115902854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115902855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115902855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:06.264540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17145): Terminating (SIGTERM) 11:59:06.307126 run iperf3-srv_10.42.42.10(pid=17146): Terminating (SIGTERM) 11:59:06.350299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17147): Terminating (SIGTERM) 11:59:06.393360 run iperf3-srv_10.42.42.10(pid=17148): Terminating (SIGTERM) 11:59:06.435888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17149): Terminating (SIGTERM) 11:59:06.478451 run iperf3-srv_10.42.42.10(pid=17150): Terminating (SIGTERM) 11:59:06.521195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17151): Terminating (SIGTERM) 11:59:06.563505 run iperf3-srv_10.42.42.10(pid=17152): Terminating (SIGTERM) 11:59:06.606094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17155): Terminating (SIGTERM) 11:59:06.648331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17158): Terminating (SIGTERM) 11:59:06.690973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17161): Terminating (SIGTERM) 11:59:06.733425 --- ParallelTerminationStrategy: PID 17145 died... 11:59:06.753953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17145): Terminated: ok {rc=0} 11:59:06.801252 --- ParallelTerminationStrategy: PID 17146 died... 11:59:06.821331 run iperf3-srv_10.42.42.10(pid=17146): Terminated {rc=256} 11:59:06.868427 --- ParallelTerminationStrategy: PID 17147 died... 11:59:06.888482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17147): Terminated: ok {rc=0} 11:59:06.935371 --- ParallelTerminationStrategy: PID 17148 died... 11:59:06.955533 run iperf3-srv_10.42.42.10(pid=17148): Terminated {rc=256} 11:59:07.002359 --- ParallelTerminationStrategy: PID 17149 died... 11:59:07.022330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17149): Terminated: ok {rc=0} 11:59:07.069358 --- ParallelTerminationStrategy: PID 17150 died... 11:59:07.089528 run iperf3-srv_10.42.42.10(pid=17150): Terminated {rc=256} 11:59:07.136406 --- ParallelTerminationStrategy: PID 17151 died... 11:59:07.156663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17151): Terminated: ok {rc=0} 11:59:07.203677 --- ParallelTerminationStrategy: PID 17152 died... 11:59:07.224145 run iperf3-srv_10.42.42.10(pid=17152): Terminated {rc=256} 11:59:07.270953 --- ParallelTerminationStrategy: PID 17155 died... 11:59:07.290942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17155): Terminated: ok {rc=0} 11:59:07.337541 --- ParallelTerminationStrategy: PID 17158 died... 11:59:07.357431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17158): Terminated: ok {rc=0} 11:59:07.403860 --- ParallelTerminationStrategy: PID 17161 died... 11:59:07.423916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17161): Terminated: ok {rc=0} 11:59:07.513264 bus /gobi_4: Setting Powered False 11:59:08.613155 bus /gobi_4: Setting Powered False 11:59:09.730816 bus /gobi_1: Setting Powered False 11:59:10.833742 bus /gobi_1: Setting Powered False 11:59:11.955301 bus /gobi_0: Setting Powered False 11:59:13.054387 bus /gobi_0: Setting Powered False 11:59:14.173255 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:59:15.278010 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:15.290302 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:59:15.364604 tst ping.py: using LAC 33790 11:59:15.493592 tst ping.py: using RAC 130 11:59:15.621435 tst ping.py: using CellId 33790 11:59:15.744676 tst ping.py: using BVCI 33791 11:59:15.857412 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:15.869107 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:15.881070 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:15.893326 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:15.909043 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:15.922965 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:15.940367 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:15.955945 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:59:16.108598 tst ping.py:19: start network... 11:59:16.357516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:16.876936 run create_hlr_db(pid=17163): Launched 11:59:17.041986 bus /gobi_6: Setting Powered False 11:59:18.106562 run create_hlr_db(pid=17163): Terminated: ok {rc=0} 11:59:18.550039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17165): Launched 11:59:18.856854 run osmo-hlr_10.42.42.2(pid=17166): Launched 11:59:18.975664 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:19.506833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17168): Launched 11:59:19.811871 run osmo-stp_10.42.42.5(pid=17169): Launched 11:59:19.927750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:20.453422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17171): Launched 11:59:20.570931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:20.829700 run patchelf(pid=17172): Launched 11:59:20.999814 run osmo-stp_10.42.42.5(pid=17169): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17169)] 11:59:21.129350 run osmo-stp_10.42.42.5(pid=17169): stdout: | (launched: 2022-12-13_11:59:19.755929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:21.260422 run osmo-stp_10.42.42.5(pid=17169): stderr: | 20221213115919924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115919924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115919925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115919925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115919926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115919926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115919926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:21.391300 run osmo-stp_10.42.42.5(pid=17169): stdout: | (launched: 2022-12-13_11:59:19.755929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:21.516252 run osmo-stp_10.42.42.5(pid=17169): stderr: | 20221213115919924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115919924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115919925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115919925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115919926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115919926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115919926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:21.664432 run patchelf(pid=17172): Terminating (SIGINT) 11:59:21.835143 run patchelf(pid=17172): Terminated: ok {rc=0} 11:59:21.957883 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17169): Process ended prematurely: osmo-stp_10.42.42.5(pid=17169) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17169)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 11:59:21.967010 tst ping.py:22: Test FAILED (6.7 sec) 11:59:21.993890 run osmo-hlr_10.42.42.2(pid=17166): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17166)] 11:59:22.041491 run osmo-hlr_10.42.42.2(pid=17166): stdout: | (launched: 2022-12-13_11:59:18.800658) 11:59:22.090932 run osmo-hlr_10.42.42.2(pid=17166): stderr: | 20221213115918977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115918977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115918977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115918977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115918977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115918977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115918990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115918998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115918998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115918998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:22.140928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17165): Terminating (SIGTERM) 11:59:22.181182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17168): Terminating (SIGTERM) 11:59:22.221234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17171): Terminating (SIGTERM) 11:59:22.262151 --- ParallelTerminationStrategy: PID 17165 died... 11:59:22.281478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17165): Terminated: ok {rc=0} 11:59:22.326148 --- ParallelTerminationStrategy: PID 17168 died... 11:59:22.345042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17168): Terminated: ok {rc=0} 11:59:22.389176 --- ParallelTerminationStrategy: PID 17171 died... 11:59:22.407847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17171): Terminated: ok {rc=0} 11:59:22.493925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:59:23.584685 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:23.597832 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:59:23.675706 tst ping_idle_ping.py: using LAC 33791 11:59:23.805346 tst ping_idle_ping.py: using RAC 131 11:59:23.934504 tst ping_idle_ping.py: using CellId 33791 11:59:24.064237 tst ping_idle_ping.py: using BVCI 33792 11:59:24.185296 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:24.197131 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:24.208510 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:24.219976 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:24.232148 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:24.244682 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:24.257071 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:59:24.269262 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:59:24.391690 tst ping_idle_ping.py:24: start network... 11:59:24.614095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:25.120143 run create_hlr_db(pid=17173): Launched 11:59:25.244674 bus /gobi_6: Setting Powered False 11:59:26.309260 run create_hlr_db(pid=17173): Terminated: ok {rc=0} 11:59:26.765138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17175): Launched 11:59:27.092070 run osmo-hlr_10.42.42.2(pid=17176): Launched 11:59:27.217296 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:27.780091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17178): Launched 11:59:28.107267 run osmo-stp_10.42.42.5(pid=17179): Launched 11:59:28.232002 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:28.795977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17181): Launched 11:59:28.921392 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:29.197220 run patchelf(pid=17182): Launched 11:59:29.379494 run osmo-stp_10.42.42.5(pid=17179): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17179)] 11:59:29.517534 run osmo-stp_10.42.42.5(pid=17179): stdout: | (launched: 2022-12-13_11:59:28.047612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:29.656873 run osmo-stp_10.42.42.5(pid=17179): stderr: | 20221213115928239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115928239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115928239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115928240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115928240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115928240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115928240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:29.796229 run osmo-stp_10.42.42.5(pid=17179): stdout: | (launched: 2022-12-13_11:59:28.047612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:29.929598 run osmo-stp_10.42.42.5(pid=17179): stderr: | 20221213115928239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115928239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115928239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115928240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115928240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115928240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115928240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:30.087570 run patchelf(pid=17182): Terminating (SIGINT) 11:59:30.269539 run patchelf(pid=17182): Terminated: ok {rc=0} 11:59:30.400818 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17179): Process ended prematurely: osmo-stp_10.42.42.5(pid=17179) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17179)] [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:59:30.410613 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:59:30.438768 run osmo-hlr_10.42.42.2(pid=17176): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17176)] 11:59:30.489911 run osmo-hlr_10.42.42.2(pid=17176): stdout: | (launched: 2022-12-13_11:59:27.032414) 11:59:30.542152 run osmo-hlr_10.42.42.2(pid=17176): stderr: | 20221213115927230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115927230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115927230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115927230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115927230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115927230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115927242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115927251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115927251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115927251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:30.595291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17175): Terminating (SIGTERM) 11:59:30.637378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17178): Terminating (SIGTERM) 11:59:30.679718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17181): Terminating (SIGTERM) 11:59:30.722243 --- ParallelTerminationStrategy: PID 17175 died... 11:59:30.742656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17175): Terminated: ok {rc=0} 11:59:30.789316 --- ParallelTerminationStrategy: PID 17178 died... 11:59:30.809260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17178): Terminated: ok {rc=0} 11:59:30.857115 --- ParallelTerminationStrategy: PID 17181 died... 11:59:30.878105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17181): Terminated: ok {rc=0} 11:59:30.981593 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:59:32.295513 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:59:32.302210 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:59:32.336457 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 11:59:32.375892 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 11:59:32.464283 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:59:32.497753 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 11:59:32.536561 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 11:59:33.136382 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 11:59:33.186723 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:33.198439 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:59:33.253357 tst cs_paging_gprs_active.py: using LAC 33792 11:59:33.376441 tst cs_paging_gprs_active.py: using RAC 132 11:59:33.500666 tst cs_paging_gprs_active.py: using CellId 33792 11:59:33.624283 tst cs_paging_gprs_active.py: using BVCI 33793 11:59:33.738831 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:33.750332 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:33.761550 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:33.772701 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:33.783880 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:33.795028 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:33.806293 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:33.817353 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:33.828634 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:59:33.951523 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:59:34.075096 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:59:34.301943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:34.637024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17186): Launched 11:59:34.927957 run iperf3-srv_10.42.42.10(pid=17187): Launched 11:59:35.053328 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:59:35.278750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:35.613213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17188): Launched 11:59:35.904395 run iperf3-srv_10.42.42.10(pid=17189): Launched 11:59:36.031182 tst cs_paging_gprs_active.py:38: start network... 11:59:36.256158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:36.771592 run create_hlr_db(pid=17190): Launched 11:59:36.900927 bus /gobi_6: Setting Powered False 11:59:37.966090 run create_hlr_db(pid=17190): Terminated: ok {rc=0} 11:59:38.407970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17192): Launched 11:59:38.721533 run osmo-hlr_10.42.42.2(pid=17193): Launched 11:59:38.841385 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:39.379008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17195): Launched 11:59:39.691324 run osmo-stp_10.42.42.5(pid=17196): Launched 11:59:39.811029 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:40.364639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17198): Launched 11:59:40.484360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:40.748031 run patchelf(pid=17199): Launched 11:59:40.922894 run osmo-stp_10.42.42.5(pid=17196): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17196)] 11:59:41.055307 run osmo-stp_10.42.42.5(pid=17196): stdout: | (launched: 2022-12-13_11:59:39.634113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:41.189239 run osmo-stp_10.42.42.5(pid=17196): stderr: | 20221213115939805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115939805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115939806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115939806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115939807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115939807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115939807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:41.322965 run osmo-stp_10.42.42.5(pid=17196): stdout: | (launched: 2022-12-13_11:59:39.634113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:41.450355 run osmo-stp_10.42.42.5(pid=17196): stderr: | 20221213115939805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115939805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115939806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115939806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115939807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115939807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115939807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:41.600924 run patchelf(pid=17199): Terminating (SIGINT) 11:59:41.775198 run patchelf(pid=17199): Terminated: ok {rc=0} 11:59:41.900639 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17196): Process ended prematurely: osmo-stp_10.42.42.5(pid=17196) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17196)] [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 11:59:41.910458 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:59:41.938046 run osmo-hlr_10.42.42.2(pid=17193): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17193)] 11:59:41.986751 run osmo-hlr_10.42.42.2(pid=17193): stdout: | (launched: 2022-12-13_11:59:38.664313) 11:59:42.037292 run osmo-hlr_10.42.42.2(pid=17193): stderr: | 20221213115938840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115938840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115938840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115938840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115938840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115938840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115938855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115938864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115938864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115938864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:42.088198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17186): Terminating (SIGTERM) 11:59:42.128982 run iperf3-srv_10.42.42.10(pid=17187): Terminating (SIGTERM) 11:59:42.170044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17188): Terminating (SIGTERM) 11:59:42.210926 run iperf3-srv_10.42.42.10(pid=17189): Terminating (SIGTERM) 11:59:42.251946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17192): Terminating (SIGTERM) 11:59:42.292893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17195): Terminating (SIGTERM) 11:59:42.334048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17198): Terminating (SIGTERM) 11:59:42.375294 --- ParallelTerminationStrategy: PID 17186 died... 11:59:42.394666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17186): Terminated: ok {rc=0} 11:59:42.439301 --- ParallelTerminationStrategy: PID 17187 died... 11:59:42.458148 run iperf3-srv_10.42.42.10(pid=17187): Terminated {rc=256} 11:59:42.502676 --- ParallelTerminationStrategy: PID 17188 died... 11:59:42.521737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17188): Terminated: ok {rc=0} 11:59:42.566208 --- ParallelTerminationStrategy: PID 17189 died... 11:59:42.585148 run iperf3-srv_10.42.42.10(pid=17189): Terminated {rc=256} 11:59:42.629715 --- ParallelTerminationStrategy: PID 17192 died... 11:59:42.649094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17192): Terminated: ok {rc=0} 11:59:42.693928 --- ParallelTerminationStrategy: PID 17195 died... 11:59:42.712841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17195): Terminated: ok {rc=0} 11:59:42.757413 --- ParallelTerminationStrategy: PID 17198 died... 11:59:42.776364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17198): Terminated: ok {rc=0} 11:59:42.863856 bus /gobi_0: Setting Powered False 11:59:43.965551 bus /gobi_0: Setting Powered False 11:59:45.082115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 11:59:46.270639 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:46.288744 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:59:46.363944 tst iperf3.py: using LAC 33793 11:59:46.523694 tst iperf3.py: using RAC 133 11:59:46.657287 tst iperf3.py: using CellId 33793 11:59:46.807890 tst iperf3.py: using BVCI 33794 11:59:46.935426 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:46.948787 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:46.962178 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:46.975432 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:46.991037 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:47.004909 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:47.019140 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:47.033133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:47.046975 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:59:47.173236 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:59:47.408458 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:47.744923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17200): Launched 11:59:48.037324 run iperf3-srv_10.42.42.10(pid=17201): Launched 11:59:48.162987 tst iperf3.py:8: start network... 11:59:48.390318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:48.906367 run create_hlr_db(pid=17202): Launched 11:59:49.035382 bus /gobi_6: Setting Powered False 11:59:50.100874 run create_hlr_db(pid=17202): Terminated: ok {rc=0} 11:59:50.544855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17204): Launched 11:59:50.857445 run osmo-hlr_10.42.42.2(pid=17205): Launched 11:59:50.976535 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:51.525566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17207): Launched 11:59:51.838037 run osmo-stp_10.42.42.5(pid=17208): Launched 11:59:51.959342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:52.494173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17210): Launched 11:59:52.613695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:52.876057 run patchelf(pid=17211): Launched 11:59:53.048848 run osmo-stp_10.42.42.5(pid=17208): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17208)] 11:59:53.179806 run osmo-stp_10.42.42.5(pid=17208): stdout: | (launched: 2022-12-13_11:59:51.780410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:53.312635 run osmo-stp_10.42.42.5(pid=17208): stderr: | 20221213115951949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115951949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115951950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115951950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115951951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115951951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115951951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:53.445383 run osmo-stp_10.42.42.5(pid=17208): stdout: | (launched: 2022-12-13_11:59:51.780410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:53.571975 run osmo-stp_10.42.42.5(pid=17208): stderr: | 20221213115951949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213115951949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213115951950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213115951950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213115951951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213115951951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213115951951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:53.722524 run patchelf(pid=17211): Terminating (SIGINT) 11:59:53.896083 run patchelf(pid=17211): Terminated: ok {rc=0} 11:59:54.021414 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17208): Process ended prematurely: osmo-stp_10.42.42.5(pid=17208) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17208)] [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 11:59:54.031028 tst iperf3.py:8: Test FAILED (7.8 sec) 11:59:54.058406 run osmo-hlr_10.42.42.2(pid=17205): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17205)] 11:59:54.106210 run osmo-hlr_10.42.42.2(pid=17205): stdout: | (launched: 2022-12-13_11:59:50.800507) 11:59:54.155488 run osmo-hlr_10.42.42.2(pid=17205): stderr: | 20221213115950976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213115950976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213115950976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213115950976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213115950976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213115950976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213115950987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213115950995 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213115950996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213115950996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:54.205307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17200): Terminating (SIGTERM) 11:59:54.245103 run iperf3-srv_10.42.42.10(pid=17201): Terminating (SIGTERM) 11:59:54.284650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17204): Terminating (SIGTERM) 11:59:54.324405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17207): Terminating (SIGTERM) 11:59:54.364152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17210): Terminating (SIGTERM) 11:59:54.403952 --- ParallelTerminationStrategy: PID 17200 died... 11:59:54.423049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17200): Terminated: ok {rc=0} 11:59:54.466928 --- ParallelTerminationStrategy: PID 17201 died... 11:59:54.485403 run iperf3-srv_10.42.42.10(pid=17201): Terminated {rc=256} 11:59:54.529359 --- ParallelTerminationStrategy: PID 17204 died... 11:59:54.547964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17204): Terminated: ok {rc=0} 11:59:54.592183 --- ParallelTerminationStrategy: PID 17207 died... 11:59:54.610961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17207): Terminated: ok {rc=0} 11:59:54.654904 --- ParallelTerminationStrategy: PID 17210 died... 11:59:54.673640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17210): Terminated: ok {rc=0} 11:59:54.760098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 11:59:55.908724 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:55.920812 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:59:55.975276 tst iperf3m4.py: using LAC 33794 11:59:56.097919 tst iperf3m4.py: using RAC 134 11:59:56.218891 tst iperf3m4.py: using CellId 33794 11:59:56.341757 tst iperf3m4.py: using BVCI 33795 11:59:56.464928 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:56.477217 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:56.489091 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:56.500890 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:56.513979 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:56.526853 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:56.539633 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:56.552769 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:59:56.565650 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:59:56.685652 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:59:56.811655 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:59:56.931699 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:59:57.050067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:59:57.260165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:57.573473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17212): Launched 11:59:57.847440 run iperf3-srv_10.42.42.10(pid=17213): Launched 11:59:57.963884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:59:58.172572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:58.485045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17214): Launched 11:59:58.756263 run iperf3-srv_10.42.42.10(pid=17215): Launched 11:59:58.874188 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:59:59.082560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:59.394535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17216): Launched 11:59:59.667045 run iperf3-srv_10.42.42.10(pid=17217): Launched 11:59:59.783538 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:59:59.992195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:00.305305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17218): Launched 12:00:00.576600 run iperf3-srv_10.42.42.10(pid=17219): Launched 12:00:00.692712 tst iperf3m4.py:8: start network... 12:00:00.911783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:01.408327 run create_hlr_db(pid=17220): Launched 12:00:01.573026 bus /gobi_6: Setting Powered False 12:00:02.647689 run create_hlr_db(pid=17220): Terminated: ok {rc=0} 12:00:03.105988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17252): Launched 12:00:03.416850 run osmo-hlr_10.42.42.2(pid=17253): Launched 12:00:03.534200 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:04.072097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17255): Launched 12:00:04.382036 run osmo-stp_10.42.42.5(pid=17256): Launched 12:00:04.499249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:05.033582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17258): Launched 12:00:05.153059 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:05.415850 run patchelf(pid=17259): Launched 12:00:05.592683 run osmo-stp_10.42.42.5(pid=17256): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17256)] 12:00:05.723830 run osmo-stp_10.42.42.5(pid=17256): stdout: | (launched: 2022-12-13_12:00:04.324834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:05.856096 run osmo-stp_10.42.42.5(pid=17256): stderr: | 20221213120004494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120004495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120004495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120004495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120004496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120004496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120004496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:05.988641 run osmo-stp_10.42.42.5(pid=17256): stdout: | (launched: 2022-12-13_12:00:04.324834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:06.114991 run osmo-stp_10.42.42.5(pid=17256): stderr: | 20221213120004494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120004495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120004495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120004495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120004496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120004496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120004496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:06.265101 run patchelf(pid=17259): Terminating (SIGINT) 12:00:06.438319 run patchelf(pid=17259): Terminated: ok {rc=0} 12:00:06.563364 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17256): Process ended prematurely: osmo-stp_10.42.42.5(pid=17256) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17256)] [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 12:00:06.573199 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:00:06.600751 run osmo-hlr_10.42.42.2(pid=17253): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17253)] 12:00:06.648624 run osmo-hlr_10.42.42.2(pid=17253): stdout: | (launched: 2022-12-13_12:00:03.359518) 12:00:06.697866 run osmo-hlr_10.42.42.2(pid=17253): stderr: | 20221213120003532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120003532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120003532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120003532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120003532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120003532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120003549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120003557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120003558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120003558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:06.747310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17212): Terminating (SIGTERM) 12:00:06.786840 run iperf3-srv_10.42.42.10(pid=17213): Terminating (SIGTERM) 12:00:06.826754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17214): Terminating (SIGTERM) 12:00:06.867121 run iperf3-srv_10.42.42.10(pid=17215): Terminating (SIGTERM) 12:00:06.906735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17216): Terminating (SIGTERM) 12:00:06.946237 run iperf3-srv_10.42.42.10(pid=17217): Terminating (SIGTERM) 12:00:06.986030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17218): Terminating (SIGTERM) 12:00:07.025768 run iperf3-srv_10.42.42.10(pid=17219): Terminating (SIGTERM) 12:00:07.065292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17252): Terminating (SIGTERM) 12:00:07.105353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17255): Terminating (SIGTERM) 12:00:07.144843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17258): Terminating (SIGTERM) 12:00:07.184614 --- ParallelTerminationStrategy: PID 17212 died... 12:00:07.203926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17212): Terminated: ok {rc=0} 12:00:07.247889 --- ParallelTerminationStrategy: PID 17213 died... 12:00:07.266604 run iperf3-srv_10.42.42.10(pid=17213): Terminated {rc=256} 12:00:07.310157 --- ParallelTerminationStrategy: PID 17214 died... 12:00:07.328898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17214): Terminated: ok {rc=0} 12:00:07.372721 --- ParallelTerminationStrategy: PID 17215 died... 12:00:07.391518 run iperf3-srv_10.42.42.10(pid=17215): Terminated {rc=256} 12:00:07.435249 --- ParallelTerminationStrategy: PID 17216 died... 12:00:07.454012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17216): Terminated: ok {rc=0} 12:00:07.497827 --- ParallelTerminationStrategy: PID 17217 died... 12:00:07.516556 run iperf3-srv_10.42.42.10(pid=17217): Terminated {rc=256} 12:00:07.560225 --- ParallelTerminationStrategy: PID 17218 died... 12:00:07.579033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17218): Terminated: ok {rc=0} 12:00:07.623396 --- ParallelTerminationStrategy: PID 17219 died... 12:00:07.642069 run iperf3-srv_10.42.42.10(pid=17219): Terminated {rc=256} 12:00:07.688493 --- ParallelTerminationStrategy: PID 17252 died... 12:00:07.708799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17252): Terminated: ok {rc=0} 12:00:07.758415 --- ParallelTerminationStrategy: PID 17255 died... 12:00:07.777289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17255): Terminated: ok {rc=0} 12:00:07.821271 --- ParallelTerminationStrategy: PID 17258 died... 12:00:07.840037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17258): Terminated: ok {rc=0} 12:00:07.925643 bus /gobi_4: Setting Powered False 12:00:09.024872 bus /gobi_4: Setting Powered False 12:00:10.138320 bus /gobi_1: Setting Powered False 12:00:11.235886 bus /gobi_1: Setting Powered False 12:00:12.355064 bus /gobi_0: Setting Powered False 12:00:13.456847 bus /gobi_0: Setting Powered False 12:00:14.589580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 12:00:15.695477 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:15.708143 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:00:15.765813 tst ping.py: using LAC 33795 12:00:15.914281 tst ping.py: using RAC 135 12:00:16.046794 tst ping.py: using CellId 33795 12:00:16.169848 tst ping.py: using BVCI 33796 12:00:16.284612 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:16.297663 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:16.310156 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:16.322579 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:16.335865 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:16.349554 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:16.363017 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:16.376298 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:00:16.500485 tst ping.py:19: start network... 12:00:16.742762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:17.253870 run create_hlr_db(pid=17613): Launched 12:00:17.382025 bus /gobi_6: Setting Powered False 12:00:18.442874 run create_hlr_db(pid=17613): Terminated: ok {rc=0} 12:00:18.867836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Launched 12:00:19.173295 run osmo-hlr_10.42.42.2(pid=17616): Launched 12:00:19.288585 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:19.812598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17618): Launched 12:00:20.116470 run osmo-stp_10.42.42.5(pid=17619): Launched 12:00:20.234563 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:20.759745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17621): Launched 12:00:20.876747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:21.134532 run patchelf(pid=17622): Launched 12:00:21.304755 run osmo-stp_10.42.42.5(pid=17619): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17619)] 12:00:21.433618 run osmo-stp_10.42.42.5(pid=17619): stdout: | (launched: 2022-12-13_12:00:20.060283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:21.563938 run osmo-stp_10.42.42.5(pid=17619): stderr: | 20221213120020231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120020231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120020231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120020232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120020232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120020232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120020232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:21.694321 run osmo-stp_10.42.42.5(pid=17619): stdout: | (launched: 2022-12-13_12:00:20.060283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:21.818973 run osmo-stp_10.42.42.5(pid=17619): stderr: | 20221213120020231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120020231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120020231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120020232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120020232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120020232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120020232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:21.966497 run patchelf(pid=17622): Terminating (SIGINT) 12:00:22.136566 run patchelf(pid=17622): Terminated: ok {rc=0} 12:00:22.259223 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17619): Process ended prematurely: osmo-stp_10.42.42.5(pid=17619) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17619)] [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 12:00:22.268223 tst ping.py:22: Test FAILED (6.6 sec) 12:00:22.295422 run osmo-hlr_10.42.42.2(pid=17616): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17616)] 12:00:22.343235 run osmo-hlr_10.42.42.2(pid=17616): stdout: | (launched: 2022-12-13_12:00:19.117083) 12:00:22.392751 run osmo-hlr_10.42.42.2(pid=17616): stderr: | 20221213120019293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120019293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120019293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120019293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120019293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120019293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120019308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120019319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120019319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120019319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:22.442797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Terminating (SIGTERM) 12:00:22.482680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17618): Terminating (SIGTERM) 12:00:22.522438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17621): Terminating (SIGTERM) 12:00:22.562449 --- ParallelTerminationStrategy: PID 17615 died... 12:00:22.582042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Terminated: ok {rc=0} 12:00:22.626524 --- ParallelTerminationStrategy: PID 17618 died... 12:00:22.645276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17618): Terminated: ok {rc=0} 12:00:22.689327 --- ParallelTerminationStrategy: PID 17621 died... 12:00:22.708102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17621): Terminated: ok {rc=0} 12:00:22.795074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 12:00:23.890001 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:23.904589 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:00:23.964124 tst ping_idle_ping.py: using LAC 33796 12:00:24.096874 tst ping_idle_ping.py: using RAC 136 12:00:24.220479 tst ping_idle_ping.py: using CellId 33796 12:00:24.341682 tst ping_idle_ping.py: using BVCI 33797 12:00:24.455416 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:24.468024 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:24.480450 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:24.492936 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:24.505436 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:24.517968 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:24.530620 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:00:24.543121 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:00:24.661776 tst ping_idle_ping.py:24: start network... 12:00:24.871311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:25.355684 run create_hlr_db(pid=17798): Launched 12:00:25.515446 bus /gobi_6: Setting Powered False 12:00:26.582258 run create_hlr_db(pid=17798): Terminated: ok {rc=0} 12:00:27.052031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17800): Launched 12:00:27.397857 run osmo-hlr_10.42.42.2(pid=17801): Launched 12:00:27.648243 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:28.323102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17803): Launched 12:00:28.675493 run osmo-stp_10.42.42.5(pid=17804): Launched 12:00:28.920037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:29.544525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17807): Launched 12:00:29.661400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:29.918934 run patchelf(pid=17808): Launched 12:00:30.090651 run osmo-stp_10.42.42.5(pid=17804): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17804)] 12:00:30.219562 run osmo-stp_10.42.42.5(pid=17804): stdout: | (launched: 2022-12-13_12:00:28.613870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:30.350235 run osmo-stp_10.42.42.5(pid=17804): stderr: | 20221213120028907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120028907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120028908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120028908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120028909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120028909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120028909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:30.480815 run osmo-stp_10.42.42.5(pid=17804): stdout: | (launched: 2022-12-13_12:00:28.613870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:30.605938 run osmo-stp_10.42.42.5(pid=17804): stderr: | 20221213120028907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120028907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120028908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120028908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120028909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120028909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120028909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:30.753990 run patchelf(pid=17808): Terminating (SIGINT) 12:00:30.930360 run patchelf(pid=17808): Terminated: ok {rc=0} 12:00:31.080851 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17804): Process ended prematurely: osmo-stp_10.42.42.5(pid=17804) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17804)] [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 12:00:31.101843 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 12:00:31.134652 run osmo-hlr_10.42.42.2(pid=17801): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17801)] 12:00:31.186943 run osmo-hlr_10.42.42.2(pid=17801): stdout: | (launched: 2022-12-13_12:00:27.336436) 12:00:31.242694 run osmo-hlr_10.42.42.2(pid=17801): stderr: | 20221213120027642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120027642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120027642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120027643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120027643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120027643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120027663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120027675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120027675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120027675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:31.298910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17800): Terminating (SIGTERM) 12:00:31.343080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17803): Terminating (SIGTERM) 12:00:31.391062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17807): Terminating (SIGTERM) 12:00:31.438323 --- ParallelTerminationStrategy: PID 17800 died... 12:00:31.460728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17800): Terminated: ok {rc=0} 12:00:31.510735 --- ParallelTerminationStrategy: PID 17803 died... 12:00:31.530842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17803): Terminated: ok {rc=0} 12:00:31.575869 --- ParallelTerminationStrategy: PID 17807 died... 12:00:31.595381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17807): Terminated: ok {rc=0} 12:00:31.681443 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:00:32.987290 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:32.994582 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:00:33.028399 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:00:33.064351 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:00:33.118153 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:00:33.152105 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:00:33.186745 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:00:33.747959 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:00:33.754182 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:00:33.766428 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:00:33.839496 tst switch_tch_pdch.py: using LAC 33797 12:00:33.968821 tst switch_tch_pdch.py: using RAC 137 12:00:34.106937 tst switch_tch_pdch.py: using CellId 33797 12:00:34.242481 tst switch_tch_pdch.py: using BVCI 33798 12:00:34.362578 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:00:34.374451 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:00:34.386209 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:00:34.397873 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:00:34.409904 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:00:34.421888 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:00:34.434029 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:00:34.446013 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:00:34.563432 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:00:34.685945 tst switch_tch_pdch.py:51: start network... 12:00:34.906339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:35.410864 run create_hlr_db(pid=17813): Launched 12:00:35.534740 bus /gobi_6: Setting Powered False 12:00:36.599239 run create_hlr_db(pid=17813): Terminated: ok {rc=0} 12:00:37.035187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17815): Launched 12:00:37.340488 run osmo-hlr_10.42.42.2(pid=17816): Launched 12:00:37.456102 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:37.996326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17818): Launched 12:00:38.302900 run osmo-stp_10.42.42.5(pid=17819): Launched 12:00:38.421730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:38.949675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17821): Launched 12:00:39.066503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:39.324940 run patchelf(pid=17822): Launched 12:00:39.494506 run osmo-stp_10.42.42.5(pid=17819): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17819)] 12:00:39.623006 run osmo-stp_10.42.42.5(pid=17819): stdout: | (launched: 2022-12-13_12:00:38.246200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:39.752755 run osmo-stp_10.42.42.5(pid=17819): stderr: | 20221213120038417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120038417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120038417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120038418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120038418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120038418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120038418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:39.882722 run osmo-stp_10.42.42.5(pid=17819): stdout: | (launched: 2022-12-13_12:00:38.246200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:40.006794 run osmo-stp_10.42.42.5(pid=17819): stderr: | 20221213120038417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120038417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120038417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120038418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120038418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120038418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120038418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:40.153749 run patchelf(pid=17822): Terminating (SIGINT) 12:00:40.323513 run patchelf(pid=17822): Terminated: ok {rc=0} 12:00:40.446153 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17819): Process ended prematurely: osmo-stp_10.42.42.5(pid=17819) [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17819)] [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:00:40.455147 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:00:40.482097 run osmo-hlr_10.42.42.2(pid=17816): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17816)] 12:00:40.529853 run osmo-hlr_10.42.42.2(pid=17816): stdout: | (launched: 2022-12-13_12:00:37.284066) 12:00:40.579362 run osmo-hlr_10.42.42.2(pid=17816): stderr: | 20221213120037460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120037460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120037460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120037460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120037460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120037460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120037473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120037485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120037485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120037485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:40.629339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17815): Terminating (SIGTERM) 12:00:40.669280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17818): Terminating (SIGTERM) 12:00:40.709235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17821): Terminating (SIGTERM) 12:00:40.749556 --- ParallelTerminationStrategy: PID 17815 died... 12:00:40.768938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17815): Terminated: ok {rc=0} 12:00:40.813233 --- ParallelTerminationStrategy: PID 17818 died... 12:00:40.832012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17818): Terminated: ok {rc=0} 12:00:40.876277 --- ParallelTerminationStrategy: PID 17821 died... 12:00:40.895096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17821): Terminated: ok {rc=0} 12:00:40.982132 bus /gobi_0: Setting Powered False 12:00:42.081655 bus /gobi_0: Setting Powered False 12:00:43.197539 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:00:44.453913 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:44.459670 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:00:44.493129 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:00:44.527896 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:00:44.584117 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:00:44.619759 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:00:44.656121 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:00:45.209719 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:00:45.215693 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:00:45.226994 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:00:45.297327 tst switch_tch_pdch.py: using LAC 33798 12:00:45.418166 tst switch_tch_pdch.py: using RAC 138 12:00:45.538800 tst switch_tch_pdch.py: using CellId 33798 12:00:45.660089 tst switch_tch_pdch.py: using BVCI 33799 12:00:45.771231 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:00:45.782429 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:00:45.793376 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:00:45.804145 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:00:45.815027 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:00:45.825963 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:00:45.836846 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:00:45.847758 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:00:45.981868 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:00:46.118410 tst switch_tch_pdch.py:51: start network... 12:00:46.363612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:46.853837 run create_hlr_db(pid=17827): Launched 12:00:47.019265 bus /gobi_6: Setting Powered False 12:00:48.083790 run create_hlr_db(pid=17827): Terminated: ok {rc=0} 12:00:48.509359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17829): Launched 12:00:48.836925 run osmo-hlr_10.42.42.2(pid=17830): Launched 12:00:48.963383 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:49.498019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17832): Launched 12:00:49.825360 run osmo-stp_10.42.42.5(pid=17833): Launched 12:00:49.951519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:50.486679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17835): Launched 12:00:50.611712 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:50.887760 run patchelf(pid=17836): Launched 12:00:51.070573 run osmo-stp_10.42.42.5(pid=17833): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17833)] 12:00:51.208224 run osmo-stp_10.42.42.5(pid=17833): stdout: | (launched: 2022-12-13_12:00:49.764930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:51.348130 run osmo-stp_10.42.42.5(pid=17833): stderr: | 20221213120049957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120049957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120049958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120049958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120049958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120049959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120049959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:51.487723 run osmo-stp_10.42.42.5(pid=17833): stdout: | (launched: 2022-12-13_12:00:49.764930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:51.621607 run osmo-stp_10.42.42.5(pid=17833): stderr: | 20221213120049957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120049957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120049958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120049958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120049958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120049959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120049959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:51.779753 run patchelf(pid=17836): Terminating (SIGINT) 12:00:51.960564 run patchelf(pid=17836): Terminated: ok {rc=0} 12:00:52.083882 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17833): Process ended prematurely: osmo-stp_10.42.42.5(pid=17833) [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17833)] [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:00:52.093125 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 12:00:52.120154 run osmo-hlr_10.42.42.2(pid=17830): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17830)] 12:00:52.168333 run osmo-hlr_10.42.42.2(pid=17830): stdout: | (launched: 2022-12-13_12:00:48.776849) 12:00:52.218306 run osmo-hlr_10.42.42.2(pid=17830): stderr: | 20221213120048976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120048976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120048976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120048976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120048976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120048976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120048990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120048998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120048998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120048999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:52.268535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17829): Terminating (SIGTERM) 12:00:52.308696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17832): Terminating (SIGTERM) 12:00:52.348744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17835): Terminating (SIGTERM) 12:00:52.389671 --- ParallelTerminationStrategy: PID 17829 died... 12:00:52.412840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17829): Terminated: ok {rc=0} 12:00:52.460009 --- ParallelTerminationStrategy: PID 17832 died... 12:00:52.481113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17832): Terminated: ok {rc=0} 12:00:52.527990 --- ParallelTerminationStrategy: PID 17835 died... 12:00:52.548391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17835): Terminated: ok {rc=0} 12:00:52.640666 bus /gobi_0: Setting Powered False 12:00:53.740267 bus /gobi_0: Setting Powered False 12:00:54.855543 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 12:00:56.107586 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:56.111399 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 12:00:56.145358 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 12:00:56.152167 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:00:56.206358 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 12:00:56.240363 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 12:00:56.247053 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:00:56.785586 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 12:00:56.790506 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 12:00:56.801535 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:00:56.849987 tst mo_mt_sms.py: using LAC 33799 12:00:56.977922 tst mo_mt_sms.py: using RAC 139 12:00:57.107236 tst mo_mt_sms.py: using CellId 33799 12:00:57.235150 tst mo_mt_sms.py: using BVCI 33800 12:00:57.353771 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:00:57.470738 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:00:57.584191 tst mo_mt_sms.py:9: start nitb and bts... 12:00:57.790391 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:00:58.410464 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17842): Launched 12:00:58.717095 run osmo-nitb_10.42.42.2(pid=17843): Launched 12:00:58.886133 run osmo-nitb_10.42.42.2(pid=17843): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17843)] 12:00:59.022210 run osmo-nitb_10.42.42.2(pid=17843): stdout: | (launched: 2022-12-13_12:00:58.660667) 12:00:59.160217 run osmo-nitb_10.42.42.2(pid=17843): stderr: | (launched: 2022-12-13_12:00:58.705816) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:00:59.299223 run osmo-nitb_10.42.42.2(pid=17843): stdout: | (launched: 2022-12-13_12:00:58.660667) 12:00:59.431042 run osmo-nitb_10.42.42.2(pid=17843): stderr: | (launched: 2022-12-13_12:00:58.705816) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17843) [trial-2389↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17843)] 12:00:59.831627 tst osmo-nitb_10.42.42.2(pid=17843): stdout: | (launched: 2022-12-13_12:00:58.660667) 12:00:59.954420 tst osmo-nitb_10.42.42.2(pid=17843): stderr: | (launched: 2022-12-13_12:00:58.705816) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:01:00.098645 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=17843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17843) [trial-2389↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17843)] [trial-2389↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 12:01:00.107339 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 12:01:00.113958 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17842): Terminating (SIGTERM) 12:01:00.322636 --- ParallelTerminationStrategy: PID 17842 died... 12:01:00.343820 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17842): Terminated: ok {rc=0} 12:01:00.430194 bus /sierra_3: Setting Powered False 12:01:01.528637 bus /sierra_3: Setting Powered False 12:01:02.650123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 sms:trx-sysmocell5000 --------------------------------------------------------------------- 12:01:03.883494 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:03.888134 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 12:01:03.922305 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:01:03.952115 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:01:04.005264 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 12:01:04.040229 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:01:04.068220 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:01:04.619002 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 12:01:04.624690 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:04.636161 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:01:04.689316 tst mo_mt_sms.py: using LAC 33800 12:01:04.819822 tst mo_mt_sms.py: using RAC 140 12:01:04.950036 tst mo_mt_sms.py: using CellId 33800 12:01:05.077996 tst mo_mt_sms.py: using BVCI 33801 12:01:05.198492 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:05.209951 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:05.221391 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:05.232325 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:05.244431 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:05.256332 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:01:05.375310 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:01:05.494544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:06.000074 run create_hlr_db(pid=17847): Launched 12:01:06.125197 bus /sierra_2: Setting Powered False 12:01:07.189903 run create_hlr_db(pid=17847): Terminated: ok {rc=0} 12:01:07.626159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17849): Launched 12:01:07.931735 run osmo-hlr_10.42.42.2(pid=17850): Launched 12:01:08.047731 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:08.571323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17852): Launched 12:01:08.875899 run osmo-stp_10.42.42.5(pid=17853): Launched 12:01:08.991699 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:09.543128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17855): Launched 12:01:09.848186 run osmo-msc_10.42.42.6(pid=17856): Launched 12:01:10.018690 run osmo-stp_10.42.42.5(pid=17853): ERR: Terminated: ERROR {rc=1} [trial-2389↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17853)] 12:01:10.146690 run osmo-stp_10.42.42.5(pid=17853): stdout: | (launched: 2022-12-13_12:01:08.819308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:10.274464 run osmo-stp_10.42.42.5(pid=17853): stderr: | 20221213120108991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120108991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120108991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120108991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120108992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120108992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120108992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:10.400807 run osmo-stp_10.42.42.5(pid=17853): stdout: | (launched: 2022-12-13_12:01:08.819308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:10.521703 run osmo-stp_10.42.42.5(pid=17853): stderr: | 20221213120108991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120108991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120108991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120108991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120108992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120108992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120108992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:10.666464 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17853): Process ended prematurely: osmo-stp_10.42.42.5(pid=17853) [trial-2389↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17853)] [trial-2389↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 12:01:10.674782 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 12:01:10.700742 run osmo-hlr_10.42.42.2(pid=17850): ERR: Terminated: ERROR {rc=237} [trial-2389↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17850)] 12:01:10.749282 run osmo-hlr_10.42.42.2(pid=17850): stdout: | (launched: 2022-12-13_12:01:07.875348) 12:01:10.798666 run osmo-hlr_10.42.42.2(pid=17850): stderr: | 20221213120108050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120108050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120108050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120108050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120108050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120108051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120108062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120108070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120108070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120108070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:10.867701 run osmo-msc_10.42.42.6(pid=17856): ERR: Terminated: ERROR {rc=2} [trial-2389↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17856)] 12:01:10.915903 run osmo-msc_10.42.42.6(pid=17856): stdout: | (launched: 2022-12-13_12:01:09.791115) 12:01:10.965505 run osmo-msc_10.42.42.6(pid=17856): stderr: | 20221213120110065 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120110066 DLGLOBAL DEBUG validating counter group 0x7fa6164f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120110066 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120110066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120110066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120110066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120110068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120110068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120110068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120110068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:11.015550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17849): Terminating (SIGTERM) 12:01:11.055574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17852): Terminating (SIGTERM) 12:01:11.095314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17855): Terminating (SIGTERM) 12:01:11.135358 --- ParallelTerminationStrategy: PID 17849 died... 12:01:11.154592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17849): Terminated: ok {rc=0} 12:01:11.198793 --- ParallelTerminationStrategy: PID 17852 died... 12:01:11.217551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17852): Terminated: ok {rc=0} 12:01:11.261477 --- ParallelTerminationStrategy: PID 17855 died... 12:01:11.280211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17855): Terminated: ok {rc=0} 12:01:11.364864 bus /sierra_3: Setting Powered False 12:01:12.463379 bus /sierra_3: Setting Powered False 12:01:13.580332 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 12:01:14.817580 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:14.821737 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 12:01:14.856645 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 12:01:14.865122 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 12:01:14.902349 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 12:01:14.937873 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 12:01:14.945367 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 12:01:15.464201 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 12:01:15.469497 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 12:01:15.480863 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:01:15.534477 tst assert_extension.py: using LAC 33801 12:01:15.662648 tst assert_extension.py: using RAC 141 12:01:15.790943 tst assert_extension.py: using CellId 33801 12:01:15.931538 tst assert_extension.py: using BVCI 33802 12:01:16.055600 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 12:01:16.176848 tst assert_extension.py:10: start nitb and bts... 12:01:16.404101 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:01:17.080449 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17861): Launched 12:01:17.422121 run osmo-nitb_10.42.42.2(pid=17862): Launched 12:01:17.605183 run osmo-nitb_10.42.42.2(pid=17862): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17862)] 12:01:17.750856 run osmo-nitb_10.42.42.2(pid=17862): stdout: | (launched: 2022-12-13_12:01:17.361548) 12:01:17.898430 run osmo-nitb_10.42.42.2(pid=17862): stderr: | (launched: 2022-12-13_12:01:17.410261) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:01:18.045627 run osmo-nitb_10.42.42.2(pid=17862): stdout: | (launched: 2022-12-13_12:01:17.361548) 12:01:18.187060 run osmo-nitb_10.42.42.2(pid=17862): stderr: | (launched: 2022-12-13_12:01:17.410261) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17862): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17862) [trial-2389↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17862)] 12:01:18.547412 tst osmo-nitb_10.42.42.2(pid=17862): stdout: | (launched: 2022-12-13_12:01:17.361548) 12:01:18.679857 tst osmo-nitb_10.42.42.2(pid=17862): stderr: | (launched: 2022-12-13_12:01:17.410261) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:01:18.835596 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17862): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17862) [trial-2389↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17862)] [trial-2389↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 12:01:18.845064 tst assert_extension.py:12: Test FAILED (3.4 sec) 12:01:18.852233 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17861): Terminating (SIGTERM) 12:01:19.063625 --- ParallelTerminationStrategy: PID 17861 died... 12:01:19.085576 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17861): Terminated: ok {rc=0} 12:01:19.175430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 12:01:20.358128 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:20.362518 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 12:01:20.397045 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:01:20.424569 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 12:01:20.463342 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 12:01:20.498917 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:01:20.527401 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 12:01:21.054862 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 12:01:21.060843 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:21.072341 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:01:21.121181 tst assert_extension.py: using LAC 33802 12:01:21.241133 tst assert_extension.py: using RAC 142 12:01:21.362642 tst assert_extension.py: using CellId 33802 12:01:21.482589 tst assert_extension.py: using BVCI 33803 12:01:21.593492 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:21.604281 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:21.615068 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:21.625766 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:21.636382 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:01:21.647083 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 12:01:21.764939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:22.270494 run create_hlr_db(pid=17866): Launched 12:01:22.397271 bus /sierra_2: Setting Powered False 12:01:23.462107 run create_hlr_db(pid=17866): Terminated: ok {rc=0} 12:01:23.899225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17868): Launched 12:01:24.204099 run osmo-hlr_10.42.42.2(pid=17869): Launched 12:01:24.320245 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:24.949707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17871): Launched 12:01:25.253046 run osmo-stp_10.42.42.5(pid=17872): Launched 12:01:25.367992 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:25.912777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17874): Launched 12:01:26.214274 run osmo-msc_10.42.42.6(pid=17875): Launched 12:01:26.383030 run osmo-stp_10.42.42.5(pid=17872): ERR: Terminated: ERROR {rc=1} [trial-2389↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17872)] 12:01:26.510057 run osmo-stp_10.42.42.5(pid=17872): stdout: | (launched: 2022-12-13_12:01:25.196799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:26.637538 run osmo-stp_10.42.42.5(pid=17872): stderr: | 20221213120125367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120125367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120125368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120125368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120125368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120125369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120125369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:26.762618 run osmo-stp_10.42.42.5(pid=17872): stdout: | (launched: 2022-12-13_12:01:25.196799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:26.883334 run osmo-stp_10.42.42.5(pid=17872): stderr: | 20221213120125367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120125367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120125368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120125368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120125368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120125369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120125369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:27.026726 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17872): Process ended prematurely: osmo-stp_10.42.42.5(pid=17872) [trial-2389↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17872)] [trial-2389↪ussd:trx-sysmocell5000↪assert_extension.py:17] 12:01:27.035380 tst assert_extension.py:17: Test FAILED (6.0 sec) 12:01:27.061664 run osmo-hlr_10.42.42.2(pid=17869): ERR: Terminated: ERROR {rc=237} [trial-2389↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17869)] 12:01:27.109764 run osmo-hlr_10.42.42.2(pid=17869): stdout: | (launched: 2022-12-13_12:01:24.147836) 12:01:27.159707 run osmo-hlr_10.42.42.2(pid=17869): stderr: | 20221213120124323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120124323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120124324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120124324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120124324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120124324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120124336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120124345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120124345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120124345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:27.229177 run osmo-msc_10.42.42.6(pid=17875): ERR: Terminated: ERROR {rc=2} [trial-2389↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17875)] 12:01:27.277234 run osmo-msc_10.42.42.6(pid=17875): stdout: | (launched: 2022-12-13_12:01:26.158462) 12:01:27.326817 run osmo-msc_10.42.42.6(pid=17875): stderr: | 20221213120126432 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120126432 DLGLOBAL DEBUG validating counter group 0x7fac63e52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120126432 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120126432 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120126433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120126433 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120126435 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120126435 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120126435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120126435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:27.376845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17868): Terminating (SIGTERM) 12:01:27.416611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17871): Terminating (SIGTERM) 12:01:27.456590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17874): Terminating (SIGTERM) 12:01:27.497365 --- ParallelTerminationStrategy: PID 17868 died... 12:01:27.516878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17868): Terminated: ok {rc=0} 12:01:27.561152 --- ParallelTerminationStrategy: PID 17871 died... 12:01:27.579868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17871): Terminated: ok {rc=0} 12:01:27.624201 --- ParallelTerminationStrategy: PID 17874 died... 12:01:27.643000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17874): Terminated: ok {rc=0} 12:01:27.729280 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:01:28.946212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:28.953204 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:01:28.987876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:01:29.014893 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:01:29.067718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:01:29.101256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:01:29.127649 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:01:29.679377 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:01:29.729404 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:29.740875 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:01:29.812244 tst mo_mt_call.py: using LAC 33803 12:01:29.934546 tst mo_mt_call.py: using RAC 143 12:01:30.056232 tst mo_mt_call.py: using CellId 33803 12:01:30.176642 tst mo_mt_call.py: using BVCI 33804 12:01:30.287719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:30.299034 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:30.310167 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:30.321326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:30.332430 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:30.343519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:01:30.463315 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:01:30.580115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:31.076700 run create_hlr_db(pid=17881): Launched 12:01:31.240422 bus /sierra_2: Setting Powered False 12:01:32.306199 run create_hlr_db(pid=17881): Terminated: ok {rc=0} 12:01:32.745395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17883): Launched 12:01:33.053729 run osmo-hlr_10.42.42.2(pid=17884): Launched 12:01:33.169885 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:33.712329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17886): Launched 12:01:34.019678 run osmo-stp_10.42.42.5(pid=17887): Launched 12:01:34.136607 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:34.691329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17889): Launched 12:01:34.999032 run osmo-msc_10.42.42.6(pid=17890): Launched 12:01:35.172446 run osmo-stp_10.42.42.5(pid=17887): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17887)] 12:01:35.301968 run osmo-stp_10.42.42.5(pid=17887): stdout: | (launched: 2022-12-13_12:01:33.963072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:35.431717 run osmo-stp_10.42.42.5(pid=17887): stderr: | 20221213120134136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120134136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120134136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120134137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120134137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120134137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120134137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:35.559665 run osmo-stp_10.42.42.5(pid=17887): stdout: | (launched: 2022-12-13_12:01:33.963072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:35.681660 run osmo-stp_10.42.42.5(pid=17887): stderr: | 20221213120134136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120134136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120134136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120134137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120134137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120134137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120134137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:35.827846 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17887): Process ended prematurely: osmo-stp_10.42.42.5(pid=17887) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17887)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:01:35.837126 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:01:35.863799 run osmo-hlr_10.42.42.2(pid=17884): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17884)] 12:01:35.911834 run osmo-hlr_10.42.42.2(pid=17884): stdout: | (launched: 2022-12-13_12:01:32.996833) 12:01:35.961630 run osmo-hlr_10.42.42.2(pid=17884): stderr: | 20221213120133176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120133176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120133176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120133176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120133176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120133176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120133187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120133197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120133198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120133198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:36.031180 run osmo-msc_10.42.42.6(pid=17890): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17890)] 12:01:36.079363 run osmo-msc_10.42.42.6(pid=17890): stdout: | (launched: 2022-12-13_12:01:34.942057) 12:01:36.129288 run osmo-msc_10.42.42.6(pid=17890): stderr: | 20221213120135215 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120135215 DLGLOBAL DEBUG validating counter group 0x7f33d806dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120135215 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120135215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120135215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120135215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120135219 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120135219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120135219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120135219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:36.179507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17883): Terminating (SIGTERM) 12:01:36.219558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17886): Terminating (SIGTERM) 12:01:36.259659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17889): Terminating (SIGTERM) 12:01:36.299952 --- ParallelTerminationStrategy: PID 17883 died... 12:01:36.319232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17883): Terminated: ok {rc=0} 12:01:36.363473 --- ParallelTerminationStrategy: PID 17886 died... 12:01:36.382339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17886): Terminated: ok {rc=0} 12:01:36.426425 --- ParallelTerminationStrategy: PID 17889 died... 12:01:36.445071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17889): Terminated: ok {rc=0} 12:01:36.530323 bus /sierra_3: Setting Powered False 12:01:37.629455 bus /sierra_3: Setting Powered False 12:01:38.746712 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:01:39.898010 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:39.910740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:01:39.985069 tst mo_mt_call_osmux.py: using LAC 33804 12:01:40.115403 tst mo_mt_call_osmux.py: using RAC 144 12:01:40.245372 tst mo_mt_call_osmux.py: using CellId 33804 12:01:40.377090 tst mo_mt_call_osmux.py: using BVCI 33805 12:01:40.498319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:40.510303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:40.522048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:40.533691 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:40.545748 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:01:40.557685 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:01:40.676168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:01:40.797984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:41.305532 run create_hlr_db(pid=17892): Launched 12:01:41.432903 bus /sierra_2: Setting Powered False 12:01:42.497882 run create_hlr_db(pid=17892): Terminated: ok {rc=0} 12:01:42.937980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17894): Launched 12:01:43.246694 run osmo-hlr_10.42.42.2(pid=17895): Launched 12:01:43.365273 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:43.897185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17897): Launched 12:01:44.205204 run osmo-stp_10.42.42.5(pid=17898): Launched 12:01:44.323143 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:44.879304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17900): Launched 12:01:45.186685 run osmo-msc_10.42.42.6(pid=17901): Launched 12:01:45.360561 run osmo-stp_10.42.42.5(pid=17898): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17898)] 12:01:45.490468 run osmo-stp_10.42.42.5(pid=17898): stdout: | (launched: 2022-12-13_12:01:44.148096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:45.620333 run osmo-stp_10.42.42.5(pid=17898): stderr: | 20221213120144320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120144321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120144321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120144321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120144322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120144322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120144322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:45.747979 run osmo-stp_10.42.42.5(pid=17898): stdout: | (launched: 2022-12-13_12:01:44.148096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:45.882118 run osmo-stp_10.42.42.5(pid=17898): stderr: | 20221213120144320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120144321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120144321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120144321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120144322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120144322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120144322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:46.057989 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17898): Process ended prematurely: osmo-stp_10.42.42.5(pid=17898) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17898)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:01:46.067732 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:01:46.095785 run osmo-hlr_10.42.42.2(pid=17895): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17895)] 12:01:46.145566 run osmo-hlr_10.42.42.2(pid=17895): stdout: | (launched: 2022-12-13_12:01:43.190009) 12:01:46.196659 run osmo-hlr_10.42.42.2(pid=17895): stderr: | 20221213120143370 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120143370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120143370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120143370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120143370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120143370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120143382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120143393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120143393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120143393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:46.267983 run osmo-msc_10.42.42.6(pid=17901): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17901)] 12:01:46.317834 run osmo-msc_10.42.42.6(pid=17901): stdout: | (launched: 2022-12-13_12:01:45.129900) 12:01:46.369433 run osmo-msc_10.42.42.6(pid=17901): stderr: | 20221213120145404 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120145405 DLGLOBAL DEBUG validating counter group 0x7f2d59222c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120145405 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120145405 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120145405 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120145405 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120145407 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120145407 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120145408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120145408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:46.421174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17894): Terminating (SIGTERM) 12:01:46.462306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17897): Terminating (SIGTERM) 12:01:46.504600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17900): Terminating (SIGTERM) 12:01:46.545506 --- ParallelTerminationStrategy: PID 17894 died... 12:01:46.564517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17894): Terminated: ok {rc=0} 12:01:46.609986 --- ParallelTerminationStrategy: PID 17897 died... 12:01:46.629292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17897): Terminated: ok {rc=0} 12:01:46.674072 --- ParallelTerminationStrategy: PID 17900 died... 12:01:46.693349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17900): Terminated: ok {rc=0} 12:01:46.779028 bus /sierra_3: Setting Powered False 12:01:47.875392 bus /sierra_3: Setting Powered False 12:01:48.991926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:01:50.251546 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:50.258791 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:01:50.294338 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:01:50.322801 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:01:50.377470 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:01:50.412281 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:01:50.440097 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:01:50.992745 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:01:51.046232 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:51.058284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:01:51.131367 tst mo_mt_call.py: using LAC 33805 12:01:51.261181 tst mo_mt_call.py: using RAC 145 12:01:51.389341 tst mo_mt_call.py: using CellId 33805 12:01:51.518927 tst mo_mt_call.py: using BVCI 33806 12:01:51.638785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:51.650619 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:51.662384 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:51.674263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:51.686352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:01:51.698324 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:01:51.815295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:01:51.937169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:52.447327 run create_hlr_db(pid=17906): Launched 12:01:52.575614 bus /sierra_2: Setting Powered False 12:01:53.641567 run create_hlr_db(pid=17906): Terminated: ok {rc=0} 12:01:54.081715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17908): Launched 12:01:54.393264 run osmo-hlr_10.42.42.2(pid=17909): Launched 12:01:54.511416 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:55.046993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17911): Launched 12:01:55.356874 run osmo-stp_10.42.42.5(pid=17912): Launched 12:01:55.474142 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:56.036529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17914): Launched 12:01:56.344561 run osmo-msc_10.42.42.6(pid=17915): Launched 12:01:56.518467 run osmo-stp_10.42.42.5(pid=17912): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17912)] 12:01:56.649529 run osmo-stp_10.42.42.5(pid=17912): stdout: | (launched: 2022-12-13_12:01:55.299993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:56.779486 run osmo-stp_10.42.42.5(pid=17912): stderr: | 20221213120155473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120155473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120155473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120155474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120155474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120155474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120155475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:56.907716 run osmo-stp_10.42.42.5(pid=17912): stdout: | (launched: 2022-12-13_12:01:55.299993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:57.029571 run osmo-stp_10.42.42.5(pid=17912): stderr: | 20221213120155473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120155473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120155473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120155474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120155474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120155474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120155475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:57.175986 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17912): Process ended prematurely: osmo-stp_10.42.42.5(pid=17912) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17912)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:01:57.185142 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:01:57.212016 run osmo-hlr_10.42.42.2(pid=17909): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17909)] 12:01:57.260270 run osmo-hlr_10.42.42.2(pid=17909): stdout: | (launched: 2022-12-13_12:01:54.334893) 12:01:57.309869 run osmo-hlr_10.42.42.2(pid=17909): stderr: | 20221213120154513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120154513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120154513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120154513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120154513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120154513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120154525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120154533 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120154534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120154534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:57.379053 run osmo-msc_10.42.42.6(pid=17915): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17915)] 12:01:57.426899 run osmo-msc_10.42.42.6(pid=17915): stdout: | (launched: 2022-12-13_12:01:56.287346) 12:01:57.476218 run osmo-msc_10.42.42.6(pid=17915): stderr: | 20221213120156561 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120156561 DLGLOBAL DEBUG validating counter group 0x7f4b9b10ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120156561 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120156561 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120156561 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120156562 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120156563 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120156564 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120156564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120156564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:57.526255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17908): Terminating (SIGTERM) 12:01:57.566547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17911): Terminating (SIGTERM) 12:01:57.606629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17914): Terminating (SIGTERM) 12:01:57.646954 --- ParallelTerminationStrategy: PID 17908 died... 12:01:57.666331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17908): Terminated: ok {rc=0} 12:01:57.710658 --- ParallelTerminationStrategy: PID 17911 died... 12:01:57.729609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17911): Terminated: ok {rc=0} 12:01:57.773413 --- ParallelTerminationStrategy: PID 17914 died... 12:01:57.792145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17914): Terminated: ok {rc=0} 12:01:57.877821 bus /sierra_3: Setting Powered False 12:01:58.977034 bus /sierra_3: Setting Powered False 12:02:00.090413 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:02:01.262479 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:01.279482 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:02:01.366741 tst mo_mt_call_osmux.py: using LAC 33806 12:02:01.508077 tst mo_mt_call_osmux.py: using RAC 146 12:02:01.651967 tst mo_mt_call_osmux.py: using CellId 33806 12:02:01.826398 tst mo_mt_call_osmux.py: using BVCI 33807 12:02:01.945420 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:01.957483 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:01.969225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:01.981107 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:01.994045 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:02.005942 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:02:02.128148 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:02:02.255623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:02.766212 run create_hlr_db(pid=17917): Launched 12:02:02.892938 bus /sierra_2: Setting Powered False 12:02:03.954112 run create_hlr_db(pid=17917): Terminated: ok {rc=0} 12:02:04.413642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17919): Launched 12:02:04.745591 run osmo-hlr_10.42.42.2(pid=17920): Launched 12:02:04.873401 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:05.441143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17922): Launched 12:02:05.772355 run osmo-stp_10.42.42.5(pid=17923): Launched 12:02:05.898352 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:06.495044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17925): Launched 12:02:06.826979 run osmo-msc_10.42.42.6(pid=17926): Launched 12:02:07.012821 run osmo-stp_10.42.42.5(pid=17923): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17923)] 12:02:07.151625 run osmo-stp_10.42.42.5(pid=17923): stdout: | (launched: 2022-12-13_12:02:05.711769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:07.291442 run osmo-stp_10.42.42.5(pid=17923): stderr: | 20221213120205905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120205906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120205906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120205906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120205907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120205907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120205907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:07.430269 run osmo-stp_10.42.42.5(pid=17923): stdout: | (launched: 2022-12-13_12:02:05.711769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:07.561413 run osmo-stp_10.42.42.5(pid=17923): stderr: | 20221213120205905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120205906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120205906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120205906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120205907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120205907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120205907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:07.718899 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17923): Process ended prematurely: osmo-stp_10.42.42.5(pid=17923) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17923)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:02:07.728883 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:02:07.756698 run osmo-hlr_10.42.42.2(pid=17920): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17920)] 12:02:07.807590 run osmo-hlr_10.42.42.2(pid=17920): stdout: | (launched: 2022-12-13_12:02:04.685216) 12:02:07.859953 run osmo-hlr_10.42.42.2(pid=17920): stderr: | 20221213120204884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120204884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120204885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120204885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120204885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120204885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120204920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120204930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120204930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120204930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:07.932240 run osmo-msc_10.42.42.6(pid=17926): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17926)] 12:02:07.982319 run osmo-msc_10.42.42.6(pid=17926): stdout: | (launched: 2022-12-13_12:02:06.766306) 12:02:08.034064 run osmo-msc_10.42.42.6(pid=17926): stderr: | 20221213120207089 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120207090 DLGLOBAL DEBUG validating counter group 0x7fae4d8c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120207090 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120207090 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120207090 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120207090 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120207092 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120207092 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120207092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120207092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:08.086224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17919): Terminating (SIGTERM) 12:02:08.128192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17922): Terminating (SIGTERM) 12:02:08.170486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17925): Terminating (SIGTERM) 12:02:08.212660 --- ParallelTerminationStrategy: PID 17919 died... 12:02:08.233372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17919): Terminated: ok {rc=0} 12:02:08.279905 --- ParallelTerminationStrategy: PID 17922 died... 12:02:08.299796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17922): Terminated: ok {rc=0} 12:02:08.346564 --- ParallelTerminationStrategy: PID 17925 died... 12:02:08.366588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17925): Terminated: ok {rc=0} 12:02:08.454323 bus /sierra_3: Setting Powered False 12:02:09.553408 bus /sierra_3: Setting Powered False 12:02:10.667965 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:02:11.923337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:11.929760 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:02:11.963864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:02:11.990637 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:02:12.043720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:02:12.079046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:02:12.106197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:02:12.656291 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:02:12.705969 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:12.717683 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:02:12.788831 tst mo_mt_call.py: using LAC 33807 12:02:12.910938 tst mo_mt_call.py: using RAC 147 12:02:13.033525 tst mo_mt_call.py: using CellId 33807 12:02:13.159261 tst mo_mt_call.py: using BVCI 33808 12:02:13.271778 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:13.283168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:13.294337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:13.305454 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:13.316601 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:13.327797 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:02:13.449450 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:02:13.567560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:14.047735 run create_hlr_db(pid=17932): Launched 12:02:14.174078 bus /sierra_2: Setting Powered False 12:02:15.235916 run create_hlr_db(pid=17932): Terminated: ok {rc=0} 12:02:15.688114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17934): Launched 12:02:16.049694 run osmo-hlr_10.42.42.2(pid=17935): Launched 12:02:16.295659 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:16.965726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17937): Launched 12:02:17.302866 run osmo-stp_10.42.42.5(pid=17938): Launched 12:02:17.432304 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:18.030092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17940): Launched 12:02:18.361405 run osmo-msc_10.42.42.6(pid=17941): Launched 12:02:18.546251 run osmo-stp_10.42.42.5(pid=17938): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17938)] 12:02:18.685252 run osmo-stp_10.42.42.5(pid=17938): stdout: | (launched: 2022-12-13_12:02:17.241493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:18.826345 run osmo-stp_10.42.42.5(pid=17938): stderr: | 20221213120217436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120217436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120217436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120217437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120217437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120217437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120217437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:18.964400 run osmo-stp_10.42.42.5(pid=17938): stdout: | (launched: 2022-12-13_12:02:17.241493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:19.095743 run osmo-stp_10.42.42.5(pid=17938): stderr: | 20221213120217436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120217436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120217436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120217437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120217437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120217437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120217437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:19.253299 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17938): Process ended prematurely: osmo-stp_10.42.42.5(pid=17938) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17938)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:02:19.262987 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:02:19.290833 run osmo-hlr_10.42.42.2(pid=17935): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17935)] 12:02:19.342493 run osmo-hlr_10.42.42.2(pid=17935): stdout: | (launched: 2022-12-13_12:02:15.988144) 12:02:19.395397 run osmo-hlr_10.42.42.2(pid=17935): stderr: | 20221213120216328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120216328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120216328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120216328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120216328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120216328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120216351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120216367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120216367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120216367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:19.468151 run osmo-msc_10.42.42.6(pid=17941): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17941)] 12:02:19.518214 run osmo-msc_10.42.42.6(pid=17941): stdout: | (launched: 2022-12-13_12:02:18.300237) 12:02:19.570345 run osmo-msc_10.42.42.6(pid=17941): stderr: | 20221213120218624 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120218624 DLGLOBAL DEBUG validating counter group 0x7f71cb3fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120218624 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120218624 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120218625 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120218625 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120218626 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120218627 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120218627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120218627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:19.622783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17934): Terminating (SIGTERM) 12:02:19.664743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17937): Terminating (SIGTERM) 12:02:19.706865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17940): Terminating (SIGTERM) 12:02:19.749555 --- ParallelTerminationStrategy: PID 17934 died... 12:02:19.769932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17934): Terminated: ok {rc=0} 12:02:19.816624 --- ParallelTerminationStrategy: PID 17937 died... 12:02:19.836553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17937): Terminated: ok {rc=0} 12:02:19.882821 --- ParallelTerminationStrategy: PID 17940 died... 12:02:19.902890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17940): Terminated: ok {rc=0} 12:02:19.992130 bus /sierra_3: Setting Powered False 12:02:21.091920 bus /sierra_3: Setting Powered False 12:02:22.209234 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:02:23.360656 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:23.373315 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:02:23.447589 tst mo_mt_call_osmux.py: using LAC 33808 12:02:23.578397 tst mo_mt_call_osmux.py: using RAC 148 12:02:23.706793 tst mo_mt_call_osmux.py: using CellId 33808 12:02:23.836906 tst mo_mt_call_osmux.py: using BVCI 33809 12:02:23.957096 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:23.969032 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:23.980725 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:23.992493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:24.004665 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:24.016715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:02:24.137868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:02:24.255003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:24.733252 run create_hlr_db(pid=17943): Launched 12:02:24.860074 bus /sierra_2: Setting Powered False 12:02:25.921834 run create_hlr_db(pid=17943): Terminated: ok {rc=0} 12:02:26.374935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17945): Launched 12:02:26.706733 run osmo-hlr_10.42.42.2(pid=17946): Launched 12:02:26.834098 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:27.407079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17948): Launched 12:02:27.737942 run osmo-stp_10.42.42.5(pid=17949): Launched 12:02:27.864572 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:28.465930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17951): Launched 12:02:28.796371 run osmo-msc_10.42.42.6(pid=17952): Launched 12:02:28.981174 run osmo-stp_10.42.42.5(pid=17949): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17949)] 12:02:29.125514 run osmo-stp_10.42.42.5(pid=17949): stdout: | (launched: 2022-12-13_12:02:27.677391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:29.264066 run osmo-stp_10.42.42.5(pid=17949): stderr: | 20221213120227871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120227871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120227871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120227872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120227872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120227872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120227872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:29.403222 run osmo-stp_10.42.42.5(pid=17949): stdout: | (launched: 2022-12-13_12:02:27.677391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:29.535023 run osmo-stp_10.42.42.5(pid=17949): stderr: | 20221213120227871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120227871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120227871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120227872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120227872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120227872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120227872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:29.692768 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17949): Process ended prematurely: osmo-stp_10.42.42.5(pid=17949) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17949)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:02:29.702595 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:02:29.730542 run osmo-hlr_10.42.42.2(pid=17946): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17946)] 12:02:29.782088 run osmo-hlr_10.42.42.2(pid=17946): stdout: | (launched: 2022-12-13_12:02:26.646029) 12:02:29.835113 run osmo-hlr_10.42.42.2(pid=17946): stderr: | 20221213120226846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120226847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120226847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120226847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120226847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120226847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120226859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120226869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120226870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120226870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:29.908423 run osmo-msc_10.42.42.6(pid=17952): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17952)] 12:02:29.958828 run osmo-msc_10.42.42.6(pid=17952): stdout: | (launched: 2022-12-13_12:02:28.735515) 12:02:30.011758 run osmo-msc_10.42.42.6(pid=17952): stderr: | 20221213120229060 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120229060 DLGLOBAL DEBUG validating counter group 0x7fa6748c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120229060 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120229060 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120229060 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120229060 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120229062 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120229063 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120229063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120229063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:30.064735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17945): Terminating (SIGTERM) 12:02:30.106620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17948): Terminating (SIGTERM) 12:02:30.149073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17951): Terminating (SIGTERM) 12:02:30.191750 --- ParallelTerminationStrategy: PID 17945 died... 12:02:30.212284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17945): Terminated: ok {rc=0} 12:02:30.259151 --- ParallelTerminationStrategy: PID 17948 died... 12:02:30.279179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17948): Terminated: ok {rc=0} 12:02:30.325985 --- ParallelTerminationStrategy: PID 17951 died... 12:02:30.346206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17951): Terminated: ok {rc=0} 12:02:30.435596 bus /sierra_3: Setting Powered False 12:02:31.545132 bus /sierra_3: Setting Powered False 12:02:32.674289 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:02:33.934246 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:33.941345 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:02:33.977521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:02:34.005953 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:02:34.063067 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:02:34.097156 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:02:34.124037 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:02:34.679206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:02:34.728667 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:34.740134 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:02:34.810914 tst mo_mt_call.py: using LAC 33809 12:02:34.932380 tst mo_mt_call.py: using RAC 149 12:02:35.059490 tst mo_mt_call.py: using CellId 33809 12:02:35.185552 tst mo_mt_call.py: using BVCI 33810 12:02:35.296849 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:35.308233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:35.319483 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:35.330633 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:35.341989 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:35.353243 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:02:35.470684 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:02:35.591335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:36.101799 run create_hlr_db(pid=17958): Launched 12:02:36.229872 bus /sierra_2: Setting Powered False 12:02:37.295083 run create_hlr_db(pid=17958): Terminated: ok {rc=0} 12:02:37.735792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17960): Launched 12:02:38.044940 run osmo-hlr_10.42.42.2(pid=17961): Launched 12:02:38.162551 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:38.691655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17963): Launched 12:02:39.001142 run osmo-stp_10.42.42.5(pid=17964): Launched 12:02:39.118808 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:39.675380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17966): Launched 12:02:39.984881 run osmo-msc_10.42.42.6(pid=17967): Launched 12:02:40.157396 run osmo-stp_10.42.42.5(pid=17964): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17964)] 12:02:40.287470 run osmo-stp_10.42.42.5(pid=17964): stdout: | (launched: 2022-12-13_12:02:38.944202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:40.417507 run osmo-stp_10.42.42.5(pid=17964): stderr: | 20221213120239116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120239116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120239116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120239117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120239117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120239117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120239117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:40.545824 run osmo-stp_10.42.42.5(pid=17964): stdout: | (launched: 2022-12-13_12:02:38.944202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:40.668379 run osmo-stp_10.42.42.5(pid=17964): stderr: | 20221213120239116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120239116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120239116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120239117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120239117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120239117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120239117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:40.814717 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17964): Process ended prematurely: osmo-stp_10.42.42.5(pid=17964) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17964)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:02:40.823597 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:02:40.849931 run osmo-hlr_10.42.42.2(pid=17961): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17961)] 12:02:40.897487 run osmo-hlr_10.42.42.2(pid=17961): stdout: | (launched: 2022-12-13_12:02:37.987722) 12:02:40.946827 run osmo-hlr_10.42.42.2(pid=17961): stderr: | 20221213120238166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120238166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120238166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120238166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120238166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120238166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120238183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120238194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120238194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120238194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:41.016009 run osmo-msc_10.42.42.6(pid=17967): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17967)] 12:02:41.063644 run osmo-msc_10.42.42.6(pid=17967): stdout: | (launched: 2022-12-13_12:02:39.928215) 12:02:41.112903 run osmo-msc_10.42.42.6(pid=17967): stderr: | 20221213120240203 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120240203 DLGLOBAL DEBUG validating counter group 0x7f11ea0afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120240203 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120240203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120240203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120240203 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120240207 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120240207 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120240208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120240208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:41.162536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17960): Terminating (SIGTERM) 12:02:41.202237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17963): Terminating (SIGTERM) 12:02:41.242081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17966): Terminating (SIGTERM) 12:02:41.282148 --- ParallelTerminationStrategy: PID 17960 died... 12:02:41.301383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17960): Terminated: ok {rc=0} 12:02:41.345305 --- ParallelTerminationStrategy: PID 17963 died... 12:02:41.363764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17963): Terminated: ok {rc=0} 12:02:41.407615 --- ParallelTerminationStrategy: PID 17966 died... 12:02:41.426248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17966): Terminated: ok {rc=0} 12:02:41.509657 bus /sierra_3: Setting Powered False 12:02:42.605609 bus /sierra_3: Setting Powered False 12:02:43.717908 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:02:44.866923 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:44.879521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:02:44.953057 tst mo_mt_call_osmux.py: using LAC 33810 12:02:45.084246 tst mo_mt_call_osmux.py: using RAC 150 12:02:45.214312 tst mo_mt_call_osmux.py: using CellId 33810 12:02:45.342301 tst mo_mt_call_osmux.py: using BVCI 33811 12:02:45.462411 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:45.474283 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:45.485918 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:45.497660 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:45.509727 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:02:45.521693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:02:45.640013 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:02:45.761405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:46.284661 run create_hlr_db(pid=17969): Launched 12:02:46.451291 bus /sierra_2: Setting Powered False 12:02:47.516345 run create_hlr_db(pid=17969): Terminated: ok {rc=0} 12:02:47.958138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17971): Launched 12:02:48.268715 run osmo-hlr_10.42.42.2(pid=17972): Launched 12:02:48.386608 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:48.923911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17974): Launched 12:02:49.234174 run osmo-stp_10.42.42.5(pid=17975): Launched 12:02:49.353209 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:49.912804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17977): Launched 12:02:50.221222 run osmo-msc_10.42.42.6(pid=17978): Launched 12:02:50.394301 run osmo-stp_10.42.42.5(pid=17975): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17975)] 12:02:50.524349 run osmo-stp_10.42.42.5(pid=17975): stdout: | (launched: 2022-12-13_12:02:49.176859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:50.654624 run osmo-stp_10.42.42.5(pid=17975): stderr: | 20221213120249349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120249349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120249349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120249350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120249350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120249350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120249350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:50.782272 run osmo-stp_10.42.42.5(pid=17975): stdout: | (launched: 2022-12-13_12:02:49.176859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:50.904351 run osmo-stp_10.42.42.5(pid=17975): stderr: | 20221213120249349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120249349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120249349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120249350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120249350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120249350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120249350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:51.050835 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17975): Process ended prematurely: osmo-stp_10.42.42.5(pid=17975) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17975)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:02:51.059904 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:02:51.086298 run osmo-hlr_10.42.42.2(pid=17972): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17972)] 12:02:51.134042 run osmo-hlr_10.42.42.2(pid=17972): stdout: | (launched: 2022-12-13_12:02:48.211799) 12:02:51.183855 run osmo-hlr_10.42.42.2(pid=17972): stderr: | 20221213120248391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120248391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120248391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120248391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120248391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120248391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120248404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120248413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120248413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120248413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:51.253248 run osmo-msc_10.42.42.6(pid=17978): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17978)] 12:02:51.301246 run osmo-msc_10.42.42.6(pid=17978): stdout: | (launched: 2022-12-13_12:02:50.164083) 12:02:51.350918 run osmo-msc_10.42.42.6(pid=17978): stderr: | 20221213120250436 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120250436 DLGLOBAL DEBUG validating counter group 0x7f709376bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120250437 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120250437 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120250437 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120250437 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120250439 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120250439 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120250439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120250439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:51.401083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17971): Terminating (SIGTERM) 12:02:51.441129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17974): Terminating (SIGTERM) 12:02:51.481225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17977): Terminating (SIGTERM) 12:02:51.521568 --- ParallelTerminationStrategy: PID 17971 died... 12:02:51.540779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17971): Terminated: ok {rc=0} 12:02:51.585112 --- ParallelTerminationStrategy: PID 17974 died... 12:02:51.603821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17974): Terminated: ok {rc=0} 12:02:51.647965 --- ParallelTerminationStrategy: PID 17977 died... 12:02:51.666643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17977): Terminated: ok {rc=0} 12:02:51.751482 bus /sierra_3: Setting Powered False 12:02:52.847199 bus /sierra_3: Setting Powered False 12:02:53.962729 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:02:55.217324 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:55.223752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:02:55.257649 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:02:55.284549 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:02:55.338006 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:02:55.372035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:02:55.398845 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:02:55.951191 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:02:56.001622 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:56.013100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:02:56.083801 tst mo_mt_call.py: using LAC 33811 12:02:56.204767 tst mo_mt_call.py: using RAC 151 12:02:56.329342 tst mo_mt_call.py: using CellId 33811 12:02:56.451739 tst mo_mt_call.py: using BVCI 33812 12:02:56.565697 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:56.576878 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:56.588327 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:56.599463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:56.610679 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:02:56.621818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:02:56.743322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:02:56.861748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:57.340226 run create_hlr_db(pid=17983): Launched 12:02:57.466876 bus /sierra_2: Setting Powered False 12:02:58.528520 run create_hlr_db(pid=17983): Terminated: ok {rc=0} 12:02:58.979838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17985): Launched 12:02:59.314066 run osmo-hlr_10.42.42.2(pid=17986): Launched 12:02:59.443464 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:00.015575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17988): Launched 12:03:00.349129 run osmo-stp_10.42.42.5(pid=17989): Launched 12:03:00.475840 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:01.103286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17991): Launched 12:03:01.478209 run osmo-msc_10.42.42.6(pid=17993): Launched 12:03:01.946026 run osmo-stp_10.42.42.5(pid=17989): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17989)] 12:03:02.158865 run osmo-stp_10.42.42.5(pid=17989): stdout: | (launched: 2022-12-13_12:03:00.288290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:02.292499 run osmo-stp_10.42.42.5(pid=17989): stderr: | 20221213120300483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120300483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120300483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120300484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120300486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120300486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120300486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:02.422471 run osmo-stp_10.42.42.5(pid=17989): stdout: | (launched: 2022-12-13_12:03:00.288290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:02.545618 run osmo-stp_10.42.42.5(pid=17989): stderr: | 20221213120300483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120300483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120300483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120300484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120300486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120300486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120300486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:02.693557 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17989): Process ended prematurely: osmo-stp_10.42.42.5(pid=17989) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17989)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:03:02.702487 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 12:03:02.729300 run osmo-hlr_10.42.42.2(pid=17986): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17986)] 12:03:02.777883 run osmo-hlr_10.42.42.2(pid=17986): stdout: | (launched: 2022-12-13_12:02:59.253692) 12:03:02.828270 run osmo-hlr_10.42.42.2(pid=17986): stderr: | 20221213120259454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120259454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120259454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120259454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120259454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120259454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120259466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120259475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120259475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120259475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:02.898474 run osmo-msc_10.42.42.6(pid=17993): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17993)] 12:03:02.947128 run osmo-msc_10.42.42.6(pid=17993): stdout: | (launched: 2022-12-13_12:03:01.417355) 12:03:02.997362 run osmo-msc_10.42.42.6(pid=17993): stderr: | 20221213120301789 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120301789 DLGLOBAL DEBUG validating counter group 0x7f037ec61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120301790 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120301790 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120301791 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120301792 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120301794 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120301794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120301794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120301794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:03.047871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17985): Terminating (SIGTERM) 12:03:03.089008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17988): Terminating (SIGTERM) 12:03:03.130358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17991): Terminating (SIGTERM) 12:03:03.171701 --- ParallelTerminationStrategy: PID 17985 died... 12:03:03.191257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17985): Terminated: ok {rc=0} 12:03:03.236065 --- ParallelTerminationStrategy: PID 17988 died... 12:03:03.255002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17988): Terminated: ok {rc=0} 12:03:03.299519 --- ParallelTerminationStrategy: PID 17991 died... 12:03:03.318413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17991): Terminated: ok {rc=0} 12:03:03.403864 bus /sierra_3: Setting Powered False 12:03:04.499994 bus /sierra_3: Setting Powered False 12:03:05.615015 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:03:06.761616 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:06.773777 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:03:06.845651 tst mo_mt_call_osmux.py: using LAC 33812 12:03:06.976268 tst mo_mt_call_osmux.py: using RAC 152 12:03:07.107125 tst mo_mt_call_osmux.py: using CellId 33812 12:03:07.236824 tst mo_mt_call_osmux.py: using BVCI 33813 12:03:07.359423 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:07.371678 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:07.383436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:07.395247 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:07.407441 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:07.419390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:03:07.537717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:03:07.660430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:08.172371 run create_hlr_db(pid=17995): Launched 12:03:08.300370 bus /sierra_2: Setting Powered False 12:03:09.366076 run create_hlr_db(pid=17995): Terminated: ok {rc=0} 12:03:09.809174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17997): Launched 12:03:10.129739 run osmo-hlr_10.42.42.2(pid=17998): Launched 12:03:10.260934 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:10.833374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18000): Launched 12:03:11.166509 run osmo-stp_10.42.42.5(pid=18001): Launched 12:03:11.294344 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:11.893078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18003): Launched 12:03:12.226324 run osmo-msc_10.42.42.6(pid=18004): Launched 12:03:12.412485 run osmo-stp_10.42.42.5(pid=18001): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18001)] 12:03:12.551976 run osmo-stp_10.42.42.5(pid=18001): stdout: | (launched: 2022-12-13_12:03:11.105808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:12.692378 run osmo-stp_10.42.42.5(pid=18001): stderr: | 20221213120311299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120311299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120311299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120311300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120311300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120311300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120311300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:12.831836 run osmo-stp_10.42.42.5(pid=18001): stdout: | (launched: 2022-12-13_12:03:11.105808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:12.963751 run osmo-stp_10.42.42.5(pid=18001): stderr: | 20221213120311299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120311299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120311299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120311300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120311300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120311300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120311300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:13.122115 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18001): Process ended prematurely: osmo-stp_10.42.42.5(pid=18001) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18001)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:03:13.131900 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:03:13.160065 run osmo-hlr_10.42.42.2(pid=17998): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17998)] 12:03:13.211470 run osmo-hlr_10.42.42.2(pid=17998): stdout: | (launched: 2022-12-13_12:03:10.069252) 12:03:13.264176 run osmo-hlr_10.42.42.2(pid=17998): stderr: | 20221213120310270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120310270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120310270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120310270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120310270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120310270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120310282 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120310291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120310291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120310291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:13.338048 run osmo-msc_10.42.42.6(pid=18004): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18004)] 12:03:13.388815 run osmo-msc_10.42.42.6(pid=18004): stdout: | (launched: 2022-12-13_12:03:12.165224) 12:03:13.441792 run osmo-msc_10.42.42.6(pid=18004): stderr: | 20221213120312492 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120312492 DLGLOBAL DEBUG validating counter group 0x7f28e2172c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120312492 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120312492 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120312492 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120312493 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120312494 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120312495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120312495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120312495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:13.494805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17997): Terminating (SIGTERM) 12:03:13.536717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18000): Terminating (SIGTERM) 12:03:13.579631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18003): Terminating (SIGTERM) 12:03:13.622264 --- ParallelTerminationStrategy: PID 17997 died... 12:03:13.642794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17997): Terminated: ok {rc=0} 12:03:13.689502 --- ParallelTerminationStrategy: PID 18000 died... 12:03:13.709469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18000): Terminated: ok {rc=0} 12:03:13.756210 --- ParallelTerminationStrategy: PID 18003 died... 12:03:13.776116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18003): Terminated: ok {rc=0} 12:03:13.865142 bus /sierra_3: Setting Powered False 12:03:14.964093 bus /sierra_3: Setting Powered False 12:03:16.077459 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:03:17.346461 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:17.352862 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:03:17.386651 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:03:17.413425 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:03:17.465397 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:03:17.500541 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:03:17.529174 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:03:18.082618 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:03:18.137063 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:18.148910 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:03:18.221987 tst mo_mt_call.py: using LAC 33813 12:03:18.350057 tst mo_mt_call.py: using RAC 153 12:03:18.472301 tst mo_mt_call.py: using CellId 33813 12:03:18.591510 tst mo_mt_call.py: using BVCI 33814 12:03:18.703362 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:18.714953 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:18.726181 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:18.737569 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:18.749005 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:18.760388 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:03:18.881769 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:03:19.000895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:19.478792 run create_hlr_db(pid=18009): Launched 12:03:19.606852 bus /sierra_2: Setting Powered False 12:03:20.671677 run create_hlr_db(pid=18009): Terminated: ok {rc=0} 12:03:21.131863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18011): Launched 12:03:21.466508 run osmo-hlr_10.42.42.2(pid=18012): Launched 12:03:21.595630 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:22.167830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18014): Launched 12:03:22.501472 run osmo-stp_10.42.42.5(pid=18015): Launched 12:03:22.628455 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:23.228205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18017): Launched 12:03:23.561208 run osmo-msc_10.42.42.6(pid=18018): Launched 12:03:23.745520 run osmo-stp_10.42.42.5(pid=18015): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18015)] 12:03:23.885130 run osmo-stp_10.42.42.5(pid=18015): stdout: | (launched: 2022-12-13_12:03:22.440742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:24.025499 run osmo-stp_10.42.42.5(pid=18015): stderr: | 20221213120322636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120322636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120322636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120322637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120322637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120322637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120322637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:24.163857 run osmo-stp_10.42.42.5(pid=18015): stdout: | (launched: 2022-12-13_12:03:22.440742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:24.295595 run osmo-stp_10.42.42.5(pid=18015): stderr: | 20221213120322636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120322636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120322636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120322637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120322637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120322637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120322637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:24.454421 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18015): Process ended prematurely: osmo-stp_10.42.42.5(pid=18015) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18015)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:03:24.464137 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:03:24.492071 run osmo-hlr_10.42.42.2(pid=18012): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18012)] 12:03:24.543034 run osmo-hlr_10.42.42.2(pid=18012): stdout: | (launched: 2022-12-13_12:03:21.405837) 12:03:24.595028 run osmo-hlr_10.42.42.2(pid=18012): stderr: | 20221213120321606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120321606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120321606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120321606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120321606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120321606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120321619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120321629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120321629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120321629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:24.667689 run osmo-msc_10.42.42.6(pid=18018): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18018)] 12:03:24.717693 run osmo-msc_10.42.42.6(pid=18018): stdout: | (launched: 2022-12-13_12:03:23.500375) 12:03:24.770043 run osmo-msc_10.42.42.6(pid=18018): stderr: | 20221213120323825 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120323826 DLGLOBAL DEBUG validating counter group 0x7f1c687ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120323826 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120323826 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120323826 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120323826 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120323828 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120323828 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120323828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120323828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:24.822683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18011): Terminating (SIGTERM) 12:03:24.864273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18014): Terminating (SIGTERM) 12:03:24.906409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18017): Terminating (SIGTERM) 12:03:24.948410 --- ParallelTerminationStrategy: PID 18011 died... 12:03:24.968826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18011): Terminated: ok {rc=0} 12:03:25.015906 --- ParallelTerminationStrategy: PID 18014 died... 12:03:25.035937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18014): Terminated: ok {rc=0} 12:03:25.082016 --- ParallelTerminationStrategy: PID 18017 died... 12:03:25.101974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18017): Terminated: ok {rc=0} 12:03:25.190096 bus /sierra_3: Setting Powered False 12:03:26.289154 bus /sierra_3: Setting Powered False 12:03:27.404243 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:03:28.551444 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:28.563679 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:03:28.635836 tst mo_mt_call_osmux.py: using LAC 33814 12:03:28.766282 tst mo_mt_call_osmux.py: using RAC 154 12:03:28.894989 tst mo_mt_call_osmux.py: using CellId 33814 12:03:29.026425 tst mo_mt_call_osmux.py: using BVCI 33815 12:03:29.146716 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:29.158881 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:29.170756 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:29.182564 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:29.194713 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:29.207302 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:03:29.325117 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:03:29.442856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:29.922306 run create_hlr_db(pid=18020): Launched 12:03:30.054142 bus /sierra_2: Setting Powered False 12:03:31.118437 run create_hlr_db(pid=18020): Terminated: ok {rc=0} 12:03:31.565932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18022): Launched 12:03:31.896392 run osmo-hlr_10.42.42.2(pid=18023): Launched 12:03:32.097864 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:32.734537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18025): Launched 12:03:33.067566 run osmo-stp_10.42.42.5(pid=18026): Launched 12:03:33.196124 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:33.795653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18028): Launched 12:03:34.128564 run osmo-msc_10.42.42.6(pid=18029): Launched 12:03:34.315234 run osmo-stp_10.42.42.5(pid=18026): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18026)] 12:03:34.455755 run osmo-stp_10.42.42.5(pid=18026): stdout: | (launched: 2022-12-13_12:03:33.007183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:34.595634 run osmo-stp_10.42.42.5(pid=18026): stderr: | 20221213120333200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120333201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120333201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120333201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120333204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120333205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120333205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:34.733927 run osmo-stp_10.42.42.5(pid=18026): stdout: | (launched: 2022-12-13_12:03:33.007183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:34.865873 run osmo-stp_10.42.42.5(pid=18026): stderr: | 20221213120333200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120333201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120333201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120333201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120333204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120333205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120333205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:35.023610 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18026): Process ended prematurely: osmo-stp_10.42.42.5(pid=18026) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18026)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:03:35.033583 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:03:35.061965 run osmo-hlr_10.42.42.2(pid=18023): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18023)] 12:03:35.113566 run osmo-hlr_10.42.42.2(pid=18023): stdout: | (launched: 2022-12-13_12:03:31.829554) 12:03:35.166793 run osmo-hlr_10.42.42.2(pid=18023): stderr: | 20221213120332171 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120332171 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120332171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120332171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120332171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120332171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120332191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120332208 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120332208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120332208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:35.240291 run osmo-msc_10.42.42.6(pid=18029): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18029)] 12:03:35.291098 run osmo-msc_10.42.42.6(pid=18029): stdout: | (launched: 2022-12-13_12:03:34.067705) 12:03:35.344524 run osmo-msc_10.42.42.6(pid=18029): stderr: | 20221213120334392 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120334392 DLGLOBAL DEBUG validating counter group 0x7f187eb78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120334392 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120334392 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120334393 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120334393 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120334394 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120334395 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120334395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120334395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:35.398260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18022): Terminating (SIGTERM) 12:03:35.440873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18025): Terminating (SIGTERM) 12:03:35.484074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18028): Terminating (SIGTERM) 12:03:35.527554 --- ParallelTerminationStrategy: PID 18022 died... 12:03:35.548495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18022): Terminated: ok {rc=0} 12:03:35.596260 --- ParallelTerminationStrategy: PID 18025 died... 12:03:35.616629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18025): Terminated: ok {rc=0} 12:03:35.663940 --- ParallelTerminationStrategy: PID 18028 died... 12:03:35.684103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18028): Terminated: ok {rc=0} 12:03:35.774593 bus /sierra_3: Setting Powered False 12:03:36.875750 bus /sierra_3: Setting Powered False 12:03:37.995007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:03:39.252238 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:39.259595 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:03:39.295589 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:03:39.323704 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:03:39.377615 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:03:39.412719 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:03:39.440785 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:03:39.994749 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:03:40.048186 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:40.060078 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:03:40.134722 tst mo_mt_call.py: using LAC 33815 12:03:40.264003 tst mo_mt_call.py: using RAC 155 12:03:40.392768 tst mo_mt_call.py: using CellId 33815 12:03:40.522308 tst mo_mt_call.py: using BVCI 33816 12:03:40.645087 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:40.656836 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:40.668572 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:40.680285 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:40.692324 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:40.704330 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:03:40.827968 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:03:40.947694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:41.426308 run create_hlr_db(pid=18034): Launched 12:03:41.557036 bus /sierra_2: Setting Powered False 12:03:42.622761 run create_hlr_db(pid=18034): Terminated: ok {rc=0} 12:03:43.082965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18036): Launched 12:03:43.416625 run osmo-hlr_10.42.42.2(pid=18037): Launched 12:03:43.543651 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:44.117033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18039): Launched 12:03:44.450461 run osmo-stp_10.42.42.5(pid=18040): Launched 12:03:44.579447 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:45.177538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18042): Launched 12:03:45.511195 run osmo-msc_10.42.42.6(pid=18043): Launched 12:03:45.697953 run osmo-stp_10.42.42.5(pid=18040): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18040)] 12:03:45.837562 run osmo-stp_10.42.42.5(pid=18040): stdout: | (launched: 2022-12-13_12:03:44.389660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:46.132723 run osmo-stp_10.42.42.5(pid=18040): stderr: | 20221213120344583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120344584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120344584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120344584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120344585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120344585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120344585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:46.282649 run osmo-stp_10.42.42.5(pid=18040): stdout: | (launched: 2022-12-13_12:03:44.389660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:46.417828 run osmo-stp_10.42.42.5(pid=18040): stderr: | 20221213120344583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120344584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120344584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120344584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120344585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120344585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120344585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:46.578657 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18040): Process ended prematurely: osmo-stp_10.42.42.5(pid=18040) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18040)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:03:46.589494 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:03:46.618632 run osmo-hlr_10.42.42.2(pid=18037): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18037)] 12:03:46.672141 run osmo-hlr_10.42.42.2(pid=18037): stdout: | (launched: 2022-12-13_12:03:43.355810) 12:03:46.726145 run osmo-hlr_10.42.42.2(pid=18037): stderr: | 20221213120343556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120343556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120343556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120343556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120343556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120343556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120343568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120343577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120343577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120343577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:46.801149 run osmo-msc_10.42.42.6(pid=18043): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18043)] 12:03:46.854180 run osmo-msc_10.42.42.6(pid=18043): stdout: | (launched: 2022-12-13_12:03:45.450485) 12:03:46.908387 run osmo-msc_10.42.42.6(pid=18043): stderr: | 20221213120345774 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120345775 DLGLOBAL DEBUG validating counter group 0x7f0a74828c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120345775 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120345775 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120345775 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120345775 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120345777 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120345777 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120345777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120345778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:46.963418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18036): Terminating (SIGTERM) 12:03:47.007062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18039): Terminating (SIGTERM) 12:03:47.052592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18042): Terminating (SIGTERM) 12:03:47.097166 --- ParallelTerminationStrategy: PID 18036 died... 12:03:47.119170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18036): Terminated: ok {rc=0} 12:03:47.167824 --- ParallelTerminationStrategy: PID 18039 died... 12:03:47.189667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18039): Terminated: ok {rc=0} 12:03:47.238509 --- ParallelTerminationStrategy: PID 18042 died... 12:03:47.260166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18042): Terminated: ok {rc=0} 12:03:47.354046 bus /sierra_3: Setting Powered False 12:03:48.454102 bus /sierra_3: Setting Powered False 12:03:49.569692 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:03:50.717687 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:50.729746 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:03:50.804819 tst mo_mt_call_osmux.py: using LAC 33816 12:03:50.934299 tst mo_mt_call_osmux.py: using RAC 156 12:03:51.071623 tst mo_mt_call_osmux.py: using CellId 33816 12:03:51.211004 tst mo_mt_call_osmux.py: using BVCI 33817 12:03:51.325645 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:51.337109 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:51.348367 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:51.359609 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:51.371235 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:03:51.382523 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:03:51.498046 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:03:51.618950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:52.097680 run create_hlr_db(pid=18045): Launched 12:03:52.223911 bus /sierra_2: Setting Powered False 12:03:53.288482 run create_hlr_db(pid=18045): Terminated: ok {rc=0} 12:03:53.730684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18047): Launched 12:03:54.040480 run osmo-hlr_10.42.42.2(pid=18048): Launched 12:03:54.158454 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:54.693659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18050): Launched 12:03:55.004904 run osmo-stp_10.42.42.5(pid=18051): Launched 12:03:55.123050 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:55.680566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18053): Launched 12:03:55.989824 run osmo-msc_10.42.42.6(pid=18054): Launched 12:03:56.164434 run osmo-stp_10.42.42.5(pid=18051): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18051)] 12:03:56.294739 run osmo-stp_10.42.42.5(pid=18051): stdout: | (launched: 2022-12-13_12:03:54.947630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:56.424873 run osmo-stp_10.42.42.5(pid=18051): stderr: | 20221213120355121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120355122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120355122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120355122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120355123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120355123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120355123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:56.553284 run osmo-stp_10.42.42.5(pid=18051): stdout: | (launched: 2022-12-13_12:03:54.947630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:56.676405 run osmo-stp_10.42.42.5(pid=18051): stderr: | 20221213120355121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120355122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120355122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120355122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120355123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120355123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120355123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:56.823265 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18051): Process ended prematurely: osmo-stp_10.42.42.5(pid=18051) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18051)] [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:03:56.832441 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:03:56.859038 run osmo-hlr_10.42.42.2(pid=18048): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18048)] 12:03:56.906860 run osmo-hlr_10.42.42.2(pid=18048): stdout: | (launched: 2022-12-13_12:03:53.983496) 12:03:56.956170 run osmo-hlr_10.42.42.2(pid=18048): stderr: | 20221213120354162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120354162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120354162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120354162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120354162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120354162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120354174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120354183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120354184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120354184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:57.025002 run osmo-msc_10.42.42.6(pid=18054): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18054)] 12:03:57.072728 run osmo-msc_10.42.42.6(pid=18054): stdout: | (launched: 2022-12-13_12:03:55.932677) 12:03:57.122220 run osmo-msc_10.42.42.6(pid=18054): stderr: | 20221213120356207 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120356207 DLGLOBAL DEBUG validating counter group 0x7fbeccc7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120356207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120356208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120356208 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120356208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120356211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120356212 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120356212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120356212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:57.171786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18047): Terminating (SIGTERM) 12:03:57.211358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18050): Terminating (SIGTERM) 12:03:57.251054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18053): Terminating (SIGTERM) 12:03:57.291027 --- ParallelTerminationStrategy: PID 18047 died... 12:03:57.310286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18047): Terminated: ok {rc=0} 12:03:57.354539 --- ParallelTerminationStrategy: PID 18050 died... 12:03:57.373170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18050): Terminated: ok {rc=0} 12:03:57.417303 --- ParallelTerminationStrategy: PID 18053 died... 12:03:57.435995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18053): Terminated: ok {rc=0} 12:03:57.519205 bus /sierra_3: Setting Powered False 12:03:58.618092 bus /sierra_3: Setting Powered False 12:03:59.735964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 12:04:01.011926 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:04:01.021195 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 12:04:01.059338 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:04:01.087096 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 12:04:01.173645 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 12:04:01.215788 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:04:01.243386 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 12:04:01.824222 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2389 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 12:04:01.830499 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:01.842456 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:04:01.894516 tst emergency_mo_mt_call.py: using LAC 33817 12:04:02.064100 tst emergency_mo_mt_call.py: using RAC 157 12:04:02.184798 tst emergency_mo_mt_call.py: using CellId 33817 12:04:02.306424 tst emergency_mo_mt_call.py: using BVCI 33818 12:04:02.416492 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:02.427593 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:02.438412 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:02.449178 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:02.459889 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:02.470688 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:02.592629 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:02.708573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:03.177805 run create_hlr_db(pid=18059): Launched 12:04:03.303850 bus /sierra_2: Setting Powered False 12:04:04.365079 run create_hlr_db(pid=18059): Terminated: ok {rc=0} 12:04:04.810072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18061): Launched 12:04:05.137698 run osmo-hlr_10.42.42.2(pid=18062): Launched 12:04:05.262938 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:05.822976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18064): Launched 12:04:06.149682 run osmo-stp_10.42.42.5(pid=18065): Launched 12:04:06.285265 tst emergency_mo_mt_call.py: using MSISDN 8146 12:04:06.457190 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:07.041995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18067): Launched 12:04:07.366896 run osmo-msc_10.42.42.6(pid=18068): Launched 12:04:07.551367 run osmo-stp_10.42.42.5(pid=18065): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18065)] 12:04:07.689191 run osmo-stp_10.42.42.5(pid=18065): stdout: | (launched: 2022-12-13_12:04:06.089960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:07.827735 run osmo-stp_10.42.42.5(pid=18065): stderr: | 20221213120406285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120406285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120406285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120406286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120406286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120406286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120406286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:07.964527 run osmo-stp_10.42.42.5(pid=18065): stdout: | (launched: 2022-12-13_12:04:06.089960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:08.094586 run osmo-stp_10.42.42.5(pid=18065): stderr: | 20221213120406285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120406285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120406285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120406286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120406286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120406286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120406286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:08.250013 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18065): Process ended prematurely: osmo-stp_10.42.42.5(pid=18065) [trial-2389↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18065)] [trial-2389↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 12:04:08.259350 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 12:04:08.287471 run osmo-hlr_10.42.42.2(pid=18062): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18062)] 12:04:08.339130 run osmo-hlr_10.42.42.2(pid=18062): stdout: | (launched: 2022-12-13_12:04:05.078060) 12:04:08.392134 run osmo-hlr_10.42.42.2(pid=18062): stderr: | 20221213120405277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120405277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120405277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120405277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120405277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120405277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120405290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120405299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120405299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120405299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:08.465152 run osmo-msc_10.42.42.6(pid=18068): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18068)] 12:04:08.515764 run osmo-msc_10.42.42.6(pid=18068): stdout: | (launched: 2022-12-13_12:04:07.307010) 12:04:08.568146 run osmo-msc_10.42.42.6(pid=18068): stderr: | 20221213120407630 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120407630 DLGLOBAL DEBUG validating counter group 0x7f5b89326c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120407630 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120407630 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120407630 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120407630 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120407632 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120407632 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120407633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120407633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:08.621194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18061): Terminating (SIGTERM) 12:04:08.663500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18064): Terminating (SIGTERM) 12:04:08.705853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18067): Terminating (SIGTERM) 12:04:08.748353 --- ParallelTerminationStrategy: PID 18061 died... 12:04:08.769137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18061): Terminated: ok {rc=0} 12:04:08.816066 --- ParallelTerminationStrategy: PID 18064 died... 12:04:08.836173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18064): Terminated: ok {rc=0} 12:04:08.882840 --- ParallelTerminationStrategy: PID 18067 died... 12:04:08.902811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18067): Terminated: ok {rc=0} 12:04:08.991053 bus /sierra_3: Setting Powered False 12:04:10.090905 bus /sierra_3: Setting Powered False 12:04:11.207105 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 12:04:12.295137 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:12.307336 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:04:12.363036 tst emergency_preemptive_call.py: using LAC 33818 12:04:12.492757 tst emergency_preemptive_call.py: using RAC 158 12:04:12.620155 tst emergency_preemptive_call.py: using CellId 33818 12:04:12.747116 tst emergency_preemptive_call.py: using BVCI 33819 12:04:12.865493 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:12.876820 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:12.888010 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:12.899149 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:12.911222 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:04:12.923249 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:13.042604 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:13.164886 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:13.281157 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:13.396445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:13.901323 run create_hlr_db(pid=18070): Launched 12:04:14.024759 bus /sierra_2: Setting Powered False 12:04:15.089206 run create_hlr_db(pid=18070): Terminated: ok {rc=0} 12:04:15.524436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18072): Launched 12:04:15.829610 run osmo-hlr_10.42.42.2(pid=18073): Launched 12:04:16.089714 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:16.688535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18075): Launched 12:04:17.054256 run osmo-stp_10.42.42.5(pid=18076): Launched 12:04:17.188605 tst emergency_preemptive_call.py: using MSISDN 8147 12:04:17.498970 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:18.045233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18078): Launched 12:04:18.348248 run osmo-msc_10.42.42.6(pid=18079): Launched 12:04:18.518301 run osmo-stp_10.42.42.5(pid=18076): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18076)] 12:04:18.646026 run osmo-stp_10.42.42.5(pid=18076): stdout: | (launched: 2022-12-13_12:04:16.995817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:18.773921 run osmo-stp_10.42.42.5(pid=18076): stderr: | 20221213120417272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120417272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120417272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120417272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120417274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120417275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120417275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:18.901216 run osmo-stp_10.42.42.5(pid=18076): stdout: | (launched: 2022-12-13_12:04:16.995817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:19.021731 run osmo-stp_10.42.42.5(pid=18076): stderr: | 20221213120417272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120417272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120417272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120417272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120417274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120417275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120417275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:19.165961 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18076): Process ended prematurely: osmo-stp_10.42.42.5(pid=18076) [trial-2389↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18076)] [trial-2389↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 12:04:19.174806 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 12:04:19.201242 run osmo-hlr_10.42.42.2(pid=18073): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18073)] 12:04:19.249493 run osmo-hlr_10.42.42.2(pid=18073): stdout: | (launched: 2022-12-13_12:04:15.773344) 12:04:19.299344 run osmo-hlr_10.42.42.2(pid=18073): stderr: | 20221213120416010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120416010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120416010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120416010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120416010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120416010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120416027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120416040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120416040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120416040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:19.369215 run osmo-msc_10.42.42.6(pid=18079): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18079)] 12:04:19.417209 run osmo-msc_10.42.42.6(pid=18079): stdout: | (launched: 2022-12-13_12:04:18.292086) 12:04:19.467042 run osmo-msc_10.42.42.6(pid=18079): stderr: | 20221213120418564 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120418564 DLGLOBAL DEBUG validating counter group 0x7f1ca1f26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120418564 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120418564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120418564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120418564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120418566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120418567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120418567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120418567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:19.516860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18072): Terminating (SIGTERM) 12:04:19.556838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18075): Terminating (SIGTERM) 12:04:19.596773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18078): Terminating (SIGTERM) 12:04:19.636837 --- ParallelTerminationStrategy: PID 18072 died... 12:04:19.656286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18072): Terminated: ok {rc=0} 12:04:19.701062 --- ParallelTerminationStrategy: PID 18075 died... 12:04:19.720133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18075): Terminated: ok {rc=0} 12:04:19.764270 --- ParallelTerminationStrategy: PID 18078 died... 12:04:19.783302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18078): Terminated: ok {rc=0} 12:04:19.870488 bus /sierra_9: Setting Powered False 12:04:20.971680 bus /sierra_9: Setting Powered False 12:04:22.088552 bus /sierra_8: Setting Powered False 12:04:23.189648 bus /sierra_8: Setting Powered False 12:04:24.309983 bus /sierra_3: Setting Powered False 12:04:25.409326 bus /sierra_3: Setting Powered False 12:04:26.526792 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 12:04:27.812436 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:04:27.817298 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 12:04:27.851274 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 12:04:27.890134 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 12:04:27.977957 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 12:04:28.011709 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 12:04:28.050311 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 12:04:28.647101 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 12:04:28.699421 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:28.710284 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:04:28.763253 tst cs_paging_gprs_active.py: using LAC 33819 12:04:28.883603 tst cs_paging_gprs_active.py: using RAC 159 12:04:29.005008 tst cs_paging_gprs_active.py: using CellId 33819 12:04:29.127701 tst cs_paging_gprs_active.py: using BVCI 33820 12:04:29.241221 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:29.252108 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:29.262825 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:29.273571 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:29.284144 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:29.294748 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:29.305518 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:29.315980 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:29.326822 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:29.447923 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:29.568549 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:04:29.794722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:30.128015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18085): Launched 12:04:30.419536 run iperf3-srv_10.42.42.10(pid=18086): Launched 12:04:30.545897 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:04:30.770323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:31.111819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18087): Launched 12:04:31.402247 run iperf3-srv_10.42.42.10(pid=18088): Launched 12:04:31.538570 tst cs_paging_gprs_active.py:38: start network... 12:04:31.753262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:32.250357 run create_hlr_db(pid=18089): Launched 12:04:32.378147 bus /sierra_2: Setting Powered False 12:04:33.439996 run create_hlr_db(pid=18089): Terminated: ok {rc=0} 12:04:33.872304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18091): Launched 12:04:34.184079 run osmo-hlr_10.42.42.2(pid=18092): Launched 12:04:34.301887 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:34.847506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18094): Launched 12:04:35.159105 run osmo-stp_10.42.42.5(pid=18095): Launched 12:04:35.276751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:04:35.812703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18097): Launched 12:04:35.931671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:04:36.194044 run patchelf(pid=18098): Launched 12:04:36.369121 run osmo-stp_10.42.42.5(pid=18095): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18095)] 12:04:36.500234 run osmo-stp_10.42.42.5(pid=18095): stdout: | (launched: 2022-12-13_12:04:35.101612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:36.633134 run osmo-stp_10.42.42.5(pid=18095): stderr: | 20221213120435273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120435273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120435273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120435274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120435274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120435274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120435274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:36.766061 run osmo-stp_10.42.42.5(pid=18095): stdout: | (launched: 2022-12-13_12:04:35.101612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:36.892718 run osmo-stp_10.42.42.5(pid=18095): stderr: | 20221213120435273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120435273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120435273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120435274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120435274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120435274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120435274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:37.043532 run patchelf(pid=18098): Terminating (SIGINT) 12:04:37.217684 run patchelf(pid=18098): Terminated: ok {rc=0} 12:04:37.342864 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18095): Process ended prematurely: osmo-stp_10.42.42.5(pid=18095) [trial-2389↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18095)] [trial-2389↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 12:04:37.352488 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:04:37.379838 run osmo-hlr_10.42.42.2(pid=18092): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18092)] 12:04:37.427521 run osmo-hlr_10.42.42.2(pid=18092): stdout: | (launched: 2022-12-13_12:04:34.126453) 12:04:37.477055 run osmo-hlr_10.42.42.2(pid=18092): stderr: | 20221213120434307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120434307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120434307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120434307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120434307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120434307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120434319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120434328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120434329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120434329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:37.527068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18085): Terminating (SIGTERM) 12:04:37.567160 run iperf3-srv_10.42.42.10(pid=18086): Terminating (SIGTERM) 12:04:37.608089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18087): Terminating (SIGTERM) 12:04:37.653155 run iperf3-srv_10.42.42.10(pid=18088): Terminating (SIGTERM) 12:04:37.695598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18091): Terminating (SIGTERM) 12:04:37.738331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18094): Terminating (SIGTERM) 12:04:37.780797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18097): Terminating (SIGTERM) 12:04:37.823806 --- ParallelTerminationStrategy: PID 18085 died... 12:04:37.844415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18085): Terminated: ok {rc=0} 12:04:37.891327 --- ParallelTerminationStrategy: PID 18086 died... 12:04:37.911320 run iperf3-srv_10.42.42.10(pid=18086): Terminated {rc=256} 12:04:37.957815 --- ParallelTerminationStrategy: PID 18087 died... 12:04:37.977921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18087): Terminated: ok {rc=0} 12:04:38.024560 --- ParallelTerminationStrategy: PID 18088 died... 12:04:38.044528 run iperf3-srv_10.42.42.10(pid=18088): Terminated {rc=256} 12:04:38.091312 --- ParallelTerminationStrategy: PID 18091 died... 12:04:38.111280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18091): Terminated: ok {rc=0} 12:04:38.157793 --- ParallelTerminationStrategy: PID 18094 died... 12:04:38.177910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18094): Terminated: ok {rc=0} 12:04:38.225086 --- ParallelTerminationStrategy: PID 18097 died... 12:04:38.245383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18097): Terminated: ok {rc=0} 12:04:38.335357 bus /gobi_0: Setting Powered False 12:04:39.432033 bus /gobi_0: Setting Powered False 12:04:40.545475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 12:04:41.698230 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:41.710409 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:04:41.765749 tst iperf3.py: using LAC 33820 12:04:41.888867 tst iperf3.py: using RAC 160 12:04:42.012708 tst iperf3.py: using CellId 33820 12:04:42.135449 tst iperf3.py: using BVCI 33821 12:04:42.250007 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:42.261151 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:42.271883 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:42.282539 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:42.293666 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:42.304782 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:42.316197 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:42.327223 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:42.338458 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:42.459133 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:04:42.684692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:43.017983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18099): Launched 12:04:43.310323 run iperf3-srv_10.42.42.10(pid=18100): Launched 12:04:43.436908 tst iperf3.py:8: start network... 12:04:43.662285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:44.177508 run create_hlr_db(pid=18101): Launched 12:04:44.306714 bus /gobi_6: Setting Powered False 12:04:45.372417 run create_hlr_db(pid=18101): Terminated: ok {rc=0} 12:04:45.817347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18103): Launched 12:04:46.151053 run osmo-hlr_10.42.42.2(pid=18104): Launched 12:04:46.419738 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:47.043319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18106): Launched 12:04:47.375904 run osmo-stp_10.42.42.5(pid=18107): Launched 12:04:47.497124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:04:48.035682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18109): Launched 12:04:48.155475 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:04:48.418333 run patchelf(pid=18110): Launched 12:04:48.593773 run osmo-stp_10.42.42.5(pid=18107): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18107)] 12:04:48.725425 run osmo-stp_10.42.42.5(pid=18107): stdout: | (launched: 2022-12-13_12:04:47.317775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:48.858418 run osmo-stp_10.42.42.5(pid=18107): stderr: | 20221213120447491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120447491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120447491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120447492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120447492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120447492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120447492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:48.991578 run osmo-stp_10.42.42.5(pid=18107): stdout: | (launched: 2022-12-13_12:04:47.317775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:49.119130 run osmo-stp_10.42.42.5(pid=18107): stderr: | 20221213120447491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120447491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120447491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120447492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120447492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120447492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120447492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:49.269566 run patchelf(pid=18110): Terminating (SIGINT) 12:04:49.443459 run patchelf(pid=18110): Terminated: ok {rc=0} 12:04:49.569512 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18107): Process ended prematurely: osmo-stp_10.42.42.5(pid=18107) [trial-2389↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18107)] [trial-2389↪gprs:trx-sysmocell5000↪iperf3.py:8] 12:04:49.579220 tst iperf3.py:8: Test FAILED (7.9 sec) 12:04:49.606543 run osmo-hlr_10.42.42.2(pid=18104): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18104)] 12:04:49.654520 run osmo-hlr_10.42.42.2(pid=18104): stdout: | (launched: 2022-12-13_12:04:46.090624) 12:04:49.704284 run osmo-hlr_10.42.42.2(pid=18104): stderr: | 20221213120446290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120446290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120446290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120446290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120446290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120446290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120446306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120446320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120446321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120446321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:49.754541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18099): Terminating (SIGTERM) 12:04:49.795048 run iperf3-srv_10.42.42.10(pid=18100): Terminating (SIGTERM) 12:04:49.835187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18103): Terminating (SIGTERM) 12:04:49.875674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18106): Terminating (SIGTERM) 12:04:49.916014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18109): Terminating (SIGTERM) 12:04:49.956773 --- ParallelTerminationStrategy: PID 18099 died... 12:04:49.976312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18099): Terminated: ok {rc=0} 12:04:50.021046 --- ParallelTerminationStrategy: PID 18100 died... 12:04:50.039890 run iperf3-srv_10.42.42.10(pid=18100): Terminated {rc=256} 12:04:50.084214 --- ParallelTerminationStrategy: PID 18103 died... 12:04:50.103050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18103): Terminated: ok {rc=0} 12:04:50.147466 --- ParallelTerminationStrategy: PID 18106 died... 12:04:50.166535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18106): Terminated: ok {rc=0} 12:04:50.211092 --- ParallelTerminationStrategy: PID 18109 died... 12:04:50.230141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18109): Terminated: ok {rc=0} 12:04:50.318194 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 12:04:51.468585 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:51.480279 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:04:51.530419 tst iperf3m4.py: using LAC 33821 12:04:51.654666 tst iperf3m4.py: using RAC 161 12:04:51.778223 tst iperf3m4.py: using CellId 33821 12:04:51.901296 tst iperf3m4.py: using BVCI 33822 12:04:52.013799 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:52.024713 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:52.035587 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:52.046307 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:52.057103 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:52.067919 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:52.078939 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:52.089790 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:04:52.100674 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:52.222316 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:52.346946 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:52.465250 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:04:52.587129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:04:52.796374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:53.108548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18111): Launched 12:04:53.379827 run iperf3-srv_10.42.42.10(pid=18112): Launched 12:04:53.496801 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:04:53.707139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:54.019527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18113): Launched 12:04:54.291310 run iperf3-srv_10.42.42.10(pid=18114): Launched 12:04:54.408333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:04:54.617916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:54.930866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18115): Launched 12:04:55.204785 run iperf3-srv_10.42.42.10(pid=18116): Launched 12:04:55.321955 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:04:55.530291 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:04:55.842656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18117): Launched 12:04:56.116083 run iperf3-srv_10.42.42.10(pid=18118): Launched 12:04:56.232872 tst iperf3m4.py:8: start network... 12:04:56.441987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:56.922579 run create_hlr_db(pid=18119): Launched 12:04:57.052202 bus /gobi_6: Setting Powered False 12:04:58.114495 run create_hlr_db(pid=18119): Terminated: ok {rc=0} 12:04:58.568113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18121): Launched 12:04:58.903131 run osmo-hlr_10.42.42.2(pid=18122): Launched 12:04:59.031356 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:59.607598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18124): Launched 12:04:59.942057 run osmo-stp_10.42.42.5(pid=18125): Launched 12:05:00.068349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:00.642415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18127): Launched 12:05:00.770746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:01.117298 run patchelf(pid=18128): Launched 12:05:01.329543 run osmo-stp_10.42.42.5(pid=18125): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18125)] 12:05:01.470168 run osmo-stp_10.42.42.5(pid=18125): stdout: | (launched: 2022-12-13_12:04:59.880832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:01.608675 run osmo-stp_10.42.42.5(pid=18125): stderr: | 20221213120500071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120500072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120500072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120500072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120500073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120500073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120500073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:01.746356 run osmo-stp_10.42.42.5(pid=18125): stdout: | (launched: 2022-12-13_12:04:59.880832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:01.879777 run osmo-stp_10.42.42.5(pid=18125): stderr: | 20221213120500071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120500072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120500072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120500072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120500073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120500073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120500073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:02.035431 run patchelf(pid=18128): Terminating (SIGINT) 12:05:02.215820 run patchelf(pid=18128): Terminated: ok {rc=0} 12:05:02.343459 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18125): Process ended prematurely: osmo-stp_10.42.42.5(pid=18125) [trial-2389↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18125)] [trial-2389↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 12:05:02.353407 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:05:02.381281 run osmo-hlr_10.42.42.2(pid=18122): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18122)] 12:05:02.431853 run osmo-hlr_10.42.42.2(pid=18122): stdout: | (launched: 2022-12-13_12:04:58.842177) 12:05:02.482659 run osmo-hlr_10.42.42.2(pid=18122): stderr: | 20221213120459039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120459039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120459039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120459039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120459039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120459039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120459051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120459062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120459062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120459062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:02.534168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18111): Terminating (SIGTERM) 12:05:02.575467 run iperf3-srv_10.42.42.10(pid=18112): Terminating (SIGTERM) 12:05:02.616568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18113): Terminating (SIGTERM) 12:05:02.658427 run iperf3-srv_10.42.42.10(pid=18114): Terminating (SIGTERM) 12:05:02.699484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18115): Terminating (SIGTERM) 12:05:02.740772 run iperf3-srv_10.42.42.10(pid=18116): Terminating (SIGTERM) 12:05:02.781692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18117): Terminating (SIGTERM) 12:05:02.823125 run iperf3-srv_10.42.42.10(pid=18118): Terminating (SIGTERM) 12:05:02.864358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18121): Terminating (SIGTERM) 12:05:02.905657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18124): Terminating (SIGTERM) 12:05:02.946690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18127): Terminating (SIGTERM) 12:05:02.988007 --- ParallelTerminationStrategy: PID 18111 died... 12:05:03.007549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18111): Terminated: ok {rc=0} 12:05:03.052874 --- ParallelTerminationStrategy: PID 18112 died... 12:05:03.072365 run iperf3-srv_10.42.42.10(pid=18112): Terminated {rc=256} 12:05:03.117456 --- ParallelTerminationStrategy: PID 18113 died... 12:05:03.136869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18113): Terminated: ok {rc=0} 12:05:03.182157 --- ParallelTerminationStrategy: PID 18114 died... 12:05:03.201795 run iperf3-srv_10.42.42.10(pid=18114): Terminated {rc=256} 12:05:03.246725 --- ParallelTerminationStrategy: PID 18115 died... 12:05:03.266192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18115): Terminated: ok {rc=0} 12:05:03.311365 --- ParallelTerminationStrategy: PID 18116 died... 12:05:03.330885 run iperf3-srv_10.42.42.10(pid=18116): Terminated {rc=256} 12:05:03.375874 --- ParallelTerminationStrategy: PID 18117 died... 12:05:03.395460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18117): Terminated: ok {rc=0} 12:05:03.440452 --- ParallelTerminationStrategy: PID 18118 died... 12:05:03.459913 run iperf3-srv_10.42.42.10(pid=18118): Terminated {rc=256} 12:05:03.504877 --- ParallelTerminationStrategy: PID 18121 died... 12:05:03.525028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18121): Terminated: ok {rc=0} 12:05:03.570735 --- ParallelTerminationStrategy: PID 18124 died... 12:05:03.589889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18124): Terminated: ok {rc=0} 12:05:03.635600 --- ParallelTerminationStrategy: PID 18127 died... 12:05:03.655195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18127): Terminated: ok {rc=0} 12:05:03.743771 bus /gobi_4: Setting Powered False 12:05:04.844938 bus /gobi_4: Setting Powered False 12:05:05.960880 bus /gobi_1: Setting Powered False 12:05:07.062458 bus /gobi_1: Setting Powered False 12:05:08.182696 bus /gobi_0: Setting Powered False 12:05:09.283102 bus /gobi_0: Setting Powered False 12:05:10.397923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 12:05:11.504084 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:11.515871 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:05:11.565619 tst ping.py: using LAC 33822 12:05:11.688191 tst ping.py: using RAC 162 12:05:11.809099 tst ping.py: using CellId 33822 12:05:11.928567 tst ping.py: using BVCI 33823 12:05:12.040592 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:12.051710 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:12.062762 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:12.073843 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:12.084822 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:12.095694 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:12.106725 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:12.117676 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:05:12.236834 tst ping.py:19: start network... 12:05:12.458585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:12.961333 run create_hlr_db(pid=18132): Launched 12:05:13.085876 bus /gobi_6: Setting Powered False 12:05:14.150029 run create_hlr_db(pid=18132): Terminated: ok {rc=0} 12:05:14.585235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18134): Launched 12:05:14.889060 run osmo-hlr_10.42.42.2(pid=18135): Launched 12:05:15.004693 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:15.530809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18137): Launched 12:05:15.845729 run osmo-stp_10.42.42.5(pid=18138): Launched 12:05:16.143856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:16.835552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18140): Launched 12:05:16.974597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:17.259821 run patchelf(pid=18141): Launched 12:05:17.442993 run osmo-stp_10.42.42.5(pid=18138): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18138)] 12:05:17.582099 run osmo-stp_10.42.42.5(pid=18138): stdout: | (launched: 2022-12-13_12:05:15.778426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:17.722394 run osmo-stp_10.42.42.5(pid=18138): stderr: | 20221213120516032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120516032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120516032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120516033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120516033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120516033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120516033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:17.863041 run osmo-stp_10.42.42.5(pid=18138): stdout: | (launched: 2022-12-13_12:05:15.778426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:17.996874 run osmo-stp_10.42.42.5(pid=18138): stderr: | 20221213120516032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120516032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120516032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120516033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120516033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120516033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120516033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:18.155618 run patchelf(pid=18141): Terminating (SIGINT) 12:05:18.337855 run patchelf(pid=18141): Terminated: ok {rc=0} 12:05:18.469908 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18138): Process ended prematurely: osmo-stp_10.42.42.5(pid=18138) [trial-2389↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18138)] [trial-2389↪gprs:trx-sysmocell5000↪ping.py:22] 12:05:18.479662 tst ping.py:22: Test FAILED (7.0 sec) 12:05:18.508440 run osmo-hlr_10.42.42.2(pid=18135): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18135)] 12:05:18.561231 run osmo-hlr_10.42.42.2(pid=18135): stdout: | (launched: 2022-12-13_12:05:14.832865) 12:05:18.614840 run osmo-hlr_10.42.42.2(pid=18135): stderr: | 20221213120515009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120515009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120515009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120515009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120515009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120515009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120515021 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120515030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120515030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120515030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:18.668650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18134): Terminating (SIGTERM) 12:05:18.711707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18137): Terminating (SIGTERM) 12:05:18.754986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18140): Terminating (SIGTERM) 12:05:18.798565 --- ParallelTerminationStrategy: PID 18134 died... 12:05:18.819200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18134): Terminated: ok {rc=0} 12:05:18.867252 --- ParallelTerminationStrategy: PID 18137 died... 12:05:18.887831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18137): Terminated: ok {rc=0} 12:05:18.935804 --- ParallelTerminationStrategy: PID 18140 died... 12:05:18.956339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18140): Terminated: ok {rc=0} 12:05:19.047325 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 12:05:20.135832 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:20.148103 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 12:05:20.201310 tst ping_idle_ping.py: using LAC 33823 12:05:20.331452 tst ping_idle_ping.py: using RAC 163 12:05:20.452626 tst ping_idle_ping.py: using CellId 33823 12:05:20.572322 tst ping_idle_ping.py: using BVCI 33824 12:05:20.684797 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:20.695942 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:20.706945 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:20.717830 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:20.728897 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:20.740206 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:20.751599 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 12:05:20.762791 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 12:05:20.883228 tst ping_idle_ping.py:24: start network... 12:05:21.104279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:21.612572 run create_hlr_db(pid=18142): Launched 12:05:21.738692 bus /gobi_6: Setting Powered False 12:05:22.803151 run create_hlr_db(pid=18142): Terminated: ok {rc=0} 12:05:23.259197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18144): Launched 12:05:23.589647 run osmo-hlr_10.42.42.2(pid=18145): Launched 12:05:23.717222 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:24.279159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18147): Launched 12:05:24.609425 run osmo-stp_10.42.42.5(pid=18148): Launched 12:05:24.728554 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:25.258130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18150): Launched 12:05:25.375838 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:25.633978 run patchelf(pid=18151): Launched 12:05:25.803696 run osmo-stp_10.42.42.5(pid=18148): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18148)] 12:05:25.932512 run osmo-stp_10.42.42.5(pid=18148): stdout: | (launched: 2022-12-13_12:05:24.549375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:26.062488 run osmo-stp_10.42.42.5(pid=18148): stderr: | 20221213120524725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120524725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120524726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120524726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120524726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120524727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120524727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:26.192855 run osmo-stp_10.42.42.5(pid=18148): stdout: | (launched: 2022-12-13_12:05:24.549375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:26.317246 run osmo-stp_10.42.42.5(pid=18148): stderr: | 20221213120524725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120524725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120524726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120524726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120524726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120524727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120524727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:26.464827 run patchelf(pid=18151): Terminating (SIGINT) 12:05:26.635025 run patchelf(pid=18151): Terminated: ok {rc=0} 12:05:26.757656 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18148): Process ended prematurely: osmo-stp_10.42.42.5(pid=18148) [trial-2389↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18148)] [trial-2389↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 12:05:26.766565 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:05:26.793446 run osmo-hlr_10.42.42.2(pid=18145): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18145)] 12:05:26.841162 run osmo-hlr_10.42.42.2(pid=18145): stdout: | (launched: 2022-12-13_12:05:23.529513) 12:05:26.890687 run osmo-hlr_10.42.42.2(pid=18145): stderr: | 20221213120523728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120523728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120523728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120523728 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120523729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120523729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120523741 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120523750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120523750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120523750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:26.940803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18144): Terminating (SIGTERM) 12:05:26.980780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18147): Terminating (SIGTERM) 12:05:27.020600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18150): Terminating (SIGTERM) 12:05:27.061143 --- ParallelTerminationStrategy: PID 18144 died... 12:05:27.080625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18144): Terminated: ok {rc=0} 12:05:27.125386 --- ParallelTerminationStrategy: PID 18147 died... 12:05:27.144216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18147): Terminated: ok {rc=0} 12:05:27.189235 --- ParallelTerminationStrategy: PID 18150 died... 12:05:27.208357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18150): Terminated: ok {rc=0} 12:05:27.292357 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 12:05:28.602805 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:05:28.608023 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:05:28.641980 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:05:28.684819 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:05:28.774759 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:05:28.809397 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:05:28.849530 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:05:29.450515 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:05:29.504702 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:29.516313 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:05:29.568695 tst cs_paging_gprs_active.py: using LAC 33824 12:05:29.701423 tst cs_paging_gprs_active.py: using RAC 164 12:05:29.831831 tst cs_paging_gprs_active.py: using CellId 33824 12:05:29.963625 tst cs_paging_gprs_active.py: using BVCI 33825 12:05:30.087042 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:30.098737 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:30.110177 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:30.121572 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:30.133080 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:30.144688 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:30.156455 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:30.168096 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:30.179829 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:05:30.302914 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:05:30.420437 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:05:30.631800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:30.977983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18157): Launched 12:05:31.272446 run iperf3-srv_10.42.42.10(pid=18158): Launched 12:05:31.414547 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:05:31.647791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:31.991356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18159): Launched 12:05:32.298893 run iperf3-srv_10.42.42.10(pid=18160): Launched 12:05:32.426584 tst cs_paging_gprs_active.py:38: start network... 12:05:32.651505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:33.168201 run create_hlr_db(pid=18161): Launched 12:05:33.297290 bus /gobi_6: Setting Powered False 12:05:34.363063 run create_hlr_db(pid=18161): Terminated: ok {rc=0} 12:05:34.809607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18163): Launched 12:05:35.124202 run osmo-hlr_10.42.42.2(pid=18164): Launched 12:05:35.243643 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:35.797031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18166): Launched 12:05:36.108632 run osmo-stp_10.42.42.5(pid=18167): Launched 12:05:36.227662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:36.765252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18169): Launched 12:05:36.885237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:37.148316 run patchelf(pid=18170): Launched 12:05:37.322209 run osmo-stp_10.42.42.5(pid=18167): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18167)] 12:05:37.454447 run osmo-stp_10.42.42.5(pid=18167): stdout: | (launched: 2022-12-13_12:05:36.051105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:37.588216 run osmo-stp_10.42.42.5(pid=18167): stderr: | 20221213120536222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120536222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120536222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120536223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120536223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120536223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120536223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:37.721611 run osmo-stp_10.42.42.5(pid=18167): stdout: | (launched: 2022-12-13_12:05:36.051105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:37.848627 run osmo-stp_10.42.42.5(pid=18167): stderr: | 20221213120536222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120536222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120536222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120536223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120536223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120536223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120536223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:37.999331 run patchelf(pid=18170): Terminating (SIGINT) 12:05:38.173956 run patchelf(pid=18170): Terminated: ok {rc=0} 12:05:38.299588 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18167): Process ended prematurely: osmo-stp_10.42.42.5(pid=18167) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18167)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:05:38.309305 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:05:38.336583 run osmo-hlr_10.42.42.2(pid=18164): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18164)] 12:05:38.384668 run osmo-hlr_10.42.42.2(pid=18164): stdout: | (launched: 2022-12-13_12:05:35.066163) 12:05:38.434479 run osmo-hlr_10.42.42.2(pid=18164): stderr: | 20221213120535245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120535245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120535245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120535245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120535245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120535245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120535257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120535266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120535266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120535266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:38.484796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18157): Terminating (SIGTERM) 12:05:38.525020 run iperf3-srv_10.42.42.10(pid=18158): Terminating (SIGTERM) 12:05:38.565165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18159): Terminating (SIGTERM) 12:05:38.605720 run iperf3-srv_10.42.42.10(pid=18160): Terminating (SIGTERM) 12:05:38.645667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18163): Terminating (SIGTERM) 12:05:38.685686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18166): Terminating (SIGTERM) 12:05:38.725773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18169): Terminating (SIGTERM) 12:05:38.765919 --- ParallelTerminationStrategy: PID 18157 died... 12:05:38.785125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18157): Terminated: ok {rc=0} 12:05:38.829653 --- ParallelTerminationStrategy: PID 18158 died... 12:05:38.848349 run iperf3-srv_10.42.42.10(pid=18158): Terminated {rc=256} 12:05:38.892372 --- ParallelTerminationStrategy: PID 18159 died... 12:05:38.911039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18159): Terminated: ok {rc=0} 12:05:38.954975 --- ParallelTerminationStrategy: PID 18160 died... 12:05:38.973741 run iperf3-srv_10.42.42.10(pid=18160): Terminated {rc=256} 12:05:39.017640 --- ParallelTerminationStrategy: PID 18163 died... 12:05:39.036354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18163): Terminated: ok {rc=0} 12:05:39.080200 --- ParallelTerminationStrategy: PID 18166 died... 12:05:39.098794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18166): Terminated: ok {rc=0} 12:05:39.142544 --- ParallelTerminationStrategy: PID 18169 died... 12:05:39.161232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18169): Terminated: ok {rc=0} 12:05:39.247588 bus /gobi_0: Setting Powered False 12:05:40.347341 bus /gobi_0: Setting Powered False 12:05:41.464016 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:05:42.617152 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:42.629593 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:05:42.689680 tst iperf3.py: using LAC 33825 12:05:42.810823 tst iperf3.py: using RAC 165 12:05:42.929773 tst iperf3.py: using CellId 33825 12:05:43.058860 tst iperf3.py: using BVCI 33826 12:05:43.179929 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:43.191559 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:43.202909 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:43.214307 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:43.226460 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:43.238687 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:43.250970 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:43.262990 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:43.275288 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:05:43.394796 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:05:43.604905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:43.916013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18171): Launched 12:05:44.187289 run iperf3-srv_10.42.42.10(pid=18172): Launched 12:05:44.305181 tst iperf3.py:8: start network... 12:05:44.513798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:44.993668 run create_hlr_db(pid=18173): Launched 12:05:45.121409 bus /gobi_6: Setting Powered False 12:05:46.199506 run create_hlr_db(pid=18173): Terminated: ok {rc=0} 12:05:46.727340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18175): Launched 12:05:47.061435 run osmo-hlr_10.42.42.2(pid=18176): Launched 12:05:47.273176 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:47.868080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18178): Launched 12:05:48.201866 run osmo-stp_10.42.42.5(pid=18179): Launched 12:05:48.331067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:48.906589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18181): Launched 12:05:49.034698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:49.316010 run patchelf(pid=18182): Launched 12:05:49.503311 run osmo-stp_10.42.42.5(pid=18179): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18179)] 12:05:49.644627 run osmo-stp_10.42.42.5(pid=18179): stdout: | (launched: 2022-12-13_12:05:48.141260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:49.786984 run osmo-stp_10.42.42.5(pid=18179): stderr: | 20221213120548335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120548335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120548336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120548336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120548337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120548337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120548337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:49.929404 run osmo-stp_10.42.42.5(pid=18179): stdout: | (launched: 2022-12-13_12:05:48.141260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:50.065609 run osmo-stp_10.42.42.5(pid=18179): stderr: | 20221213120548335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120548335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120548336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120548336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120548337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120548337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120548337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:50.227193 run patchelf(pid=18182): Terminating (SIGINT) 12:05:50.413165 run patchelf(pid=18182): Terminated: ok {rc=0} 12:05:50.547622 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18179): Process ended prematurely: osmo-stp_10.42.42.5(pid=18179) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18179)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 12:05:50.558164 tst iperf3.py:8: Test FAILED (8.0 sec) 12:05:50.587254 run osmo-hlr_10.42.42.2(pid=18176): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18176)] 12:05:50.638676 run osmo-hlr_10.42.42.2(pid=18176): stdout: | (launched: 2022-12-13_12:05:46.999512) 12:05:50.691734 run osmo-hlr_10.42.42.2(pid=18176): stderr: | 20221213120547273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120547273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120547273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120547273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120547273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120547273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120547287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120547298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120547298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120547298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:50.744851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18171): Terminating (SIGTERM) 12:05:50.787133 run iperf3-srv_10.42.42.10(pid=18172): Terminating (SIGTERM) 12:05:50.829742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18175): Terminating (SIGTERM) 12:05:50.872074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18178): Terminating (SIGTERM) 12:05:50.914323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18181): Terminating (SIGTERM) 12:05:50.956475 --- ParallelTerminationStrategy: PID 18171 died... 12:05:50.976792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18171): Terminated: ok {rc=0} 12:05:51.023326 --- ParallelTerminationStrategy: PID 18172 died... 12:05:51.043137 run iperf3-srv_10.42.42.10(pid=18172): Terminated {rc=256} 12:05:51.089470 --- ParallelTerminationStrategy: PID 18175 died... 12:05:51.109413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18175): Terminated: ok {rc=0} 12:05:51.155573 --- ParallelTerminationStrategy: PID 18178 died... 12:05:51.175492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18178): Terminated: ok {rc=0} 12:05:51.221731 --- ParallelTerminationStrategy: PID 18181 died... 12:05:51.241551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18181): Terminated: ok {rc=0} 12:05:51.330552 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:05:52.483016 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:52.495806 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:05:52.549593 tst iperf3m4.py: using LAC 33826 12:05:52.675721 tst iperf3m4.py: using RAC 166 12:05:52.797276 tst iperf3m4.py: using CellId 33826 12:05:52.919731 tst iperf3m4.py: using BVCI 33827 12:05:53.033605 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:53.044633 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:53.055562 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:53.066526 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:53.077447 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:53.088197 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:53.099312 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:53.110217 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:05:53.121189 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:05:53.243280 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:05:53.364395 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:05:53.486987 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:05:53.609445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:05:53.836357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:54.171958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18184): Launched 12:05:54.463279 run iperf3-srv_10.42.42.10(pid=18185): Launched 12:05:54.589933 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:05:54.815181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:55.150037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18186): Launched 12:05:55.440242 run iperf3-srv_10.42.42.10(pid=18187): Launched 12:05:55.567404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:05:55.793339 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:56.128024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18188): Launched 12:05:56.419817 run iperf3-srv_10.42.42.10(pid=18189): Launched 12:05:56.545636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:05:56.771241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:57.106067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18190): Launched 12:05:57.401821 run iperf3-srv_10.42.42.10(pid=18191): Launched 12:05:57.533995 tst iperf3m4.py:8: start network... 12:05:57.760550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:58.275517 run create_hlr_db(pid=18192): Launched 12:05:58.403697 bus /gobi_6: Setting Powered False 12:05:59.468802 run create_hlr_db(pid=18192): Terminated: ok {rc=0} 12:05:59.912607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18194): Launched 12:06:00.222517 run osmo-hlr_10.42.42.2(pid=18195): Launched 12:06:00.342766 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:00.921761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18197): Launched 12:06:01.289692 run osmo-stp_10.42.42.5(pid=18198): Launched 12:06:01.562073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:02.123067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18200): Launched 12:06:02.257346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:02.522536 run patchelf(pid=18201): Launched 12:06:02.695322 run osmo-stp_10.42.42.5(pid=18198): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18198)] 12:06:02.826724 run osmo-stp_10.42.42.5(pid=18198): stdout: | (launched: 2022-12-13_12:06:01.223847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:02.958884 run osmo-stp_10.42.42.5(pid=18198): stderr: | 20221213120601442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120601442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120601443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120601443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120601443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120601443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120601444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:03.091253 run osmo-stp_10.42.42.5(pid=18198): stdout: | (launched: 2022-12-13_12:06:01.223847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:03.217426 run osmo-stp_10.42.42.5(pid=18198): stderr: | 20221213120601442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120601442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120601443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120601443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120601443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120601443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120601444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:03.366895 run patchelf(pid=18201): Terminating (SIGINT) 12:06:03.539776 run patchelf(pid=18201): Terminated: ok {rc=0} 12:06:03.664894 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18198): Process ended prematurely: osmo-stp_10.42.42.5(pid=18198) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18198)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 12:06:03.674756 tst iperf3m4.py:8: Test FAILED (11.2 sec) 12:06:03.702723 run osmo-hlr_10.42.42.2(pid=18195): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18195)] 12:06:03.750653 run osmo-hlr_10.42.42.2(pid=18195): stdout: | (launched: 2022-12-13_12:06:00.164922) 12:06:03.800378 run osmo-hlr_10.42.42.2(pid=18195): stderr: | 20221213120600339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120600339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120600339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120600339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120600339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120600339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120600355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120600365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120600365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120600365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:03.850702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18184): Terminating (SIGTERM) 12:06:03.890529 run iperf3-srv_10.42.42.10(pid=18185): Terminating (SIGTERM) 12:06:03.930213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18186): Terminating (SIGTERM) 12:06:03.970158 run iperf3-srv_10.42.42.10(pid=18187): Terminating (SIGTERM) 12:06:04.010058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18188): Terminating (SIGTERM) 12:06:04.049897 run iperf3-srv_10.42.42.10(pid=18189): Terminating (SIGTERM) 12:06:04.090014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18190): Terminating (SIGTERM) 12:06:04.129947 run iperf3-srv_10.42.42.10(pid=18191): Terminating (SIGTERM) 12:06:04.169571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18194): Terminating (SIGTERM) 12:06:04.209380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18197): Terminating (SIGTERM) 12:06:04.249148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18200): Terminating (SIGTERM) 12:06:04.289331 --- ParallelTerminationStrategy: PID 18184 died... 12:06:04.308492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18184): Terminated: ok {rc=0} 12:06:04.352398 --- ParallelTerminationStrategy: PID 18185 died... 12:06:04.370867 run iperf3-srv_10.42.42.10(pid=18185): Terminated {rc=256} 12:06:04.414724 --- ParallelTerminationStrategy: PID 18186 died... 12:06:04.433289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18186): Terminated: ok {rc=0} 12:06:04.477059 --- ParallelTerminationStrategy: PID 18187 died... 12:06:04.495580 run iperf3-srv_10.42.42.10(pid=18187): Terminated {rc=256} 12:06:04.539144 --- ParallelTerminationStrategy: PID 18188 died... 12:06:04.557713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18188): Terminated: ok {rc=0} 12:06:04.601354 --- ParallelTerminationStrategy: PID 18189 died... 12:06:04.619983 run iperf3-srv_10.42.42.10(pid=18189): Terminated {rc=256} 12:06:04.663545 --- ParallelTerminationStrategy: PID 18190 died... 12:06:04.682043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18190): Terminated: ok {rc=0} 12:06:04.725692 --- ParallelTerminationStrategy: PID 18191 died... 12:06:04.744195 run iperf3-srv_10.42.42.10(pid=18191): Terminated {rc=256} 12:06:04.787771 --- ParallelTerminationStrategy: PID 18194 died... 12:06:04.806366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18194): Terminated: ok {rc=0} 12:06:04.850047 --- ParallelTerminationStrategy: PID 18197 died... 12:06:04.868629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18197): Terminated: ok {rc=0} 12:06:04.912657 --- ParallelTerminationStrategy: PID 18200 died... 12:06:04.931577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18200): Terminated: ok {rc=0} 12:06:05.016634 bus /gobi_4: Setting Powered False 12:06:06.116053 bus /gobi_4: Setting Powered False 12:06:07.233205 bus /gobi_1: Setting Powered False 12:06:08.331456 bus /gobi_1: Setting Powered False 12:06:09.447656 bus /gobi_0: Setting Powered False 12:06:10.547840 bus /gobi_0: Setting Powered False 12:06:11.663714 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 12:06:12.768804 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:12.781293 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:06:12.838497 tst ping.py: using LAC 33827 12:06:12.967052 tst ping.py: using RAC 167 12:06:13.094975 tst ping.py: using CellId 33827 12:06:13.221058 tst ping.py: using BVCI 33828 12:06:13.331962 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:13.343129 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:13.354072 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:13.365132 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:13.375933 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:13.386770 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:13.397850 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:13.409137 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:06:13.528289 tst ping.py:19: start network... 12:06:13.749148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:14.253176 run create_hlr_db(pid=18202): Launched 12:06:14.382176 bus /gobi_6: Setting Powered False 12:06:15.447040 run create_hlr_db(pid=18202): Terminated: ok {rc=0} 12:06:15.888906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18209): Launched 12:06:16.256055 run osmo-hlr_10.42.42.2(pid=18210): Launched 12:06:16.508744 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:17.197961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18212): Launched 12:06:17.526413 run osmo-stp_10.42.42.5(pid=18213): Launched 12:06:17.643970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:18.183002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18215): Launched 12:06:18.299190 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:18.556518 run patchelf(pid=18216): Launched 12:06:18.726066 run osmo-stp_10.42.42.5(pid=18213): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18213)] 12:06:18.854508 run osmo-stp_10.42.42.5(pid=18213): stdout: | (launched: 2022-12-13_12:06:17.469672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:18.984092 run osmo-stp_10.42.42.5(pid=18213): stderr: | 20221213120617640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120617640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120617640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120617641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120617641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120617641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120617641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:19.114188 run osmo-stp_10.42.42.5(pid=18213): stdout: | (launched: 2022-12-13_12:06:17.469672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:19.237826 run osmo-stp_10.42.42.5(pid=18213): stderr: | 20221213120617640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120617640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120617640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120617641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120617641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120617641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120617641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:19.384822 run patchelf(pid=18216): Terminating (SIGINT) 12:06:19.555034 run patchelf(pid=18216): Terminated: ok {rc=0} 12:06:19.677395 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18213): Process ended prematurely: osmo-stp_10.42.42.5(pid=18213) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18213)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 12:06:19.686436 tst ping.py:22: Test FAILED (6.9 sec) 12:06:19.713786 run osmo-hlr_10.42.42.2(pid=18210): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18210)] 12:06:19.761466 run osmo-hlr_10.42.42.2(pid=18210): stdout: | (launched: 2022-12-13_12:06:16.191551) 12:06:19.811110 run osmo-hlr_10.42.42.2(pid=18210): stderr: | 20221213120616624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120616624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120616624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120616624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120616624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120616624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120616657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120616679 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120616679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120616679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:19.861045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18209): Terminating (SIGTERM) 12:06:19.901068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18212): Terminating (SIGTERM) 12:06:19.941075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18215): Terminating (SIGTERM) 12:06:19.981532 --- ParallelTerminationStrategy: PID 18209 died... 12:06:20.000915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18209): Terminated: ok {rc=0} 12:06:20.045473 --- ParallelTerminationStrategy: PID 18212 died... 12:06:20.064231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18212): Terminated: ok {rc=0} 12:06:20.108611 --- ParallelTerminationStrategy: PID 18215 died... 12:06:20.127440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18215): Terminated: ok {rc=0} 12:06:20.212531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:06:21.299912 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:21.312829 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:06:21.368838 tst ping_idle_ping.py: using LAC 33828 12:06:21.498405 tst ping_idle_ping.py: using RAC 168 12:06:21.624541 tst ping_idle_ping.py: using CellId 33828 12:06:21.743809 tst ping_idle_ping.py: using BVCI 33829 12:06:21.854882 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:21.866175 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:21.877292 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:21.888261 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:21.899018 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:21.909893 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:21.920891 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:21.931735 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:06:22.052706 tst ping_idle_ping.py:24: start network... 12:06:22.274084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:22.784579 run create_hlr_db(pid=18217): Launched 12:06:22.912096 bus /gobi_6: Setting Powered False 12:06:23.977689 run create_hlr_db(pid=18217): Terminated: ok {rc=0} 12:06:24.417324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18219): Launched 12:06:24.723932 run osmo-hlr_10.42.42.2(pid=18220): Launched 12:06:24.840883 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:25.365587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18222): Launched 12:06:25.672923 run osmo-stp_10.42.42.5(pid=18223): Launched 12:06:25.789250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:26.315615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18225): Launched 12:06:26.432488 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:26.690780 run patchelf(pid=18226): Launched 12:06:26.862811 run osmo-stp_10.42.42.5(pid=18223): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18223)] 12:06:26.991643 run osmo-stp_10.42.42.5(pid=18223): stdout: | (launched: 2022-12-13_12:06:25.616011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:27.122097 run osmo-stp_10.42.42.5(pid=18223): stderr: | 20221213120625787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120625787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120625787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120625787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120625788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120625788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120625788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:27.252635 run osmo-stp_10.42.42.5(pid=18223): stdout: | (launched: 2022-12-13_12:06:25.616011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:27.377234 run osmo-stp_10.42.42.5(pid=18223): stderr: | 20221213120625787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120625787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120625787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120625787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120625788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120625788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120625788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:27.525224 run patchelf(pid=18226): Terminating (SIGINT) 12:06:27.695513 run patchelf(pid=18226): Terminated: ok {rc=0} 12:06:27.818082 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18223): Process ended prematurely: osmo-stp_10.42.42.5(pid=18223) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18223)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 12:06:27.827053 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:06:27.854147 run osmo-hlr_10.42.42.2(pid=18220): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18220)] 12:06:27.901899 run osmo-hlr_10.42.42.2(pid=18220): stdout: | (launched: 2022-12-13_12:06:24.667432) 12:06:27.950997 run osmo-hlr_10.42.42.2(pid=18220): stderr: | 20221213120624846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120624846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120624846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120624846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120624846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120624846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120624862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120624872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120624872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120624873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:28.000379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18219): Terminating (SIGTERM) 12:06:28.040125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18222): Terminating (SIGTERM) 12:06:28.079916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18225): Terminating (SIGTERM) 12:06:28.120051 --- ParallelTerminationStrategy: PID 18219 died... 12:06:28.138892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18219): Terminated: ok {rc=0} 12:06:28.182563 --- ParallelTerminationStrategy: PID 18222 died... 12:06:28.201275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18222): Terminated: ok {rc=0} 12:06:28.245462 --- ParallelTerminationStrategy: PID 18225 died... 12:06:28.264237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18225): Terminated: ok {rc=0} 12:06:28.348238 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:06:29.660430 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:06:29.666511 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:06:29.701775 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:06:29.741130 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:06:29.829544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:06:29.863260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:06:29.902260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:06:30.504250 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:06:30.554456 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:30.565617 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:06:30.636405 tst cs_paging_gprs_active.py: using LAC 33829 12:06:30.762885 tst cs_paging_gprs_active.py: using RAC 169 12:06:30.900746 tst cs_paging_gprs_active.py: using CellId 33829 12:06:31.026214 tst cs_paging_gprs_active.py: using BVCI 33830 12:06:31.178253 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:31.193220 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:31.207661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:31.221819 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:31.235442 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:31.250419 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:31.264746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:31.277808 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:31.291563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:06:31.452861 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:06:31.595841 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:06:31.852093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:32.194505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18230): Launched 12:06:32.508334 run iperf3-srv_10.42.42.10(pid=18231): Launched 12:06:32.634346 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:06:32.859084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:33.193585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18232): Launched 12:06:33.486416 run iperf3-srv_10.42.42.10(pid=18233): Launched 12:06:33.611704 tst cs_paging_gprs_active.py:38: start network... 12:06:33.836175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:34.351306 run create_hlr_db(pid=18234): Launched 12:06:34.480264 bus /gobi_6: Setting Powered False 12:06:35.544940 run create_hlr_db(pid=18234): Terminated: ok {rc=0} 12:06:35.989411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18236): Launched 12:06:36.302339 run osmo-hlr_10.42.42.2(pid=18237): Launched 12:06:36.421922 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:36.956249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18239): Launched 12:06:37.267834 run osmo-stp_10.42.42.5(pid=18240): Launched 12:06:37.386637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:37.920216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18242): Launched 12:06:38.040467 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:38.302966 run patchelf(pid=18243): Launched 12:06:38.476562 run osmo-stp_10.42.42.5(pid=18240): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18240)] 12:06:38.607823 run osmo-stp_10.42.42.5(pid=18240): stdout: | (launched: 2022-12-13_12:06:37.210427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:38.741328 run osmo-stp_10.42.42.5(pid=18240): stderr: | 20221213120637382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120637382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120637382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120637382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120637383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120637383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120637383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:38.874997 run osmo-stp_10.42.42.5(pid=18240): stdout: | (launched: 2022-12-13_12:06:37.210427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:39.001776 run osmo-stp_10.42.42.5(pid=18240): stderr: | 20221213120637382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120637382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120637382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120637382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120637383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120637383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120637383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:39.151956 run patchelf(pid=18243): Terminating (SIGINT) 12:06:39.326032 run patchelf(pid=18243): Terminated: ok {rc=0} 12:06:39.451091 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18240): Process ended prematurely: osmo-stp_10.42.42.5(pid=18240) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18240)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:06:39.460710 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:06:39.488077 run osmo-hlr_10.42.42.2(pid=18237): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18237)] 12:06:39.535876 run osmo-hlr_10.42.42.2(pid=18237): stdout: | (launched: 2022-12-13_12:06:36.244583) 12:06:39.585460 run osmo-hlr_10.42.42.2(pid=18237): stderr: | 20221213120636421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120636421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120636421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120636422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120636422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120636422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120636459 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120636469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120636469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120636469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:39.635207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18230): Terminating (SIGTERM) 12:06:39.674879 run iperf3-srv_10.42.42.10(pid=18231): Terminating (SIGTERM) 12:06:39.714380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18232): Terminating (SIGTERM) 12:06:39.753961 run iperf3-srv_10.42.42.10(pid=18233): Terminating (SIGTERM) 12:06:39.793640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18236): Terminating (SIGTERM) 12:06:39.833467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18239): Terminating (SIGTERM) 12:06:39.873333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18242): Terminating (SIGTERM) 12:06:39.913799 --- ParallelTerminationStrategy: PID 18230 died... 12:06:39.933202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18230): Terminated: ok {rc=0} 12:06:39.977733 --- ParallelTerminationStrategy: PID 18231 died... 12:06:39.996277 run iperf3-srv_10.42.42.10(pid=18231): Terminated {rc=256} 12:06:40.040128 --- ParallelTerminationStrategy: PID 18232 died... 12:06:40.058904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18232): Terminated: ok {rc=0} 12:06:40.102698 --- ParallelTerminationStrategy: PID 18233 died... 12:06:40.121329 run iperf3-srv_10.42.42.10(pid=18233): Terminated {rc=256} 12:06:40.165120 --- ParallelTerminationStrategy: PID 18236 died... 12:06:40.183817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18236): Terminated: ok {rc=0} 12:06:40.227764 --- ParallelTerminationStrategy: PID 18239 died... 12:06:40.246905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18239): Terminated: ok {rc=0} 12:06:40.290807 --- ParallelTerminationStrategy: PID 18242 died... 12:06:40.309727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18242): Terminated: ok {rc=0} 12:06:40.395833 bus /gobi_0: Setting Powered False 12:06:41.494736 bus /gobi_0: Setting Powered False 12:06:42.611179 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:06:43.758577 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:43.770673 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:06:43.845046 tst iperf3.py: using LAC 33830 12:06:43.967423 tst iperf3.py: using RAC 170 12:06:44.092186 tst iperf3.py: using CellId 33830 12:06:44.215798 tst iperf3.py: using BVCI 33831 12:06:44.330408 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:44.341626 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:44.352557 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:44.363525 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:44.374463 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:44.385437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:44.396425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:44.407236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:44.418236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:06:44.532000 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:06:44.741478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:45.053322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18244): Launched 12:06:45.325446 run iperf3-srv_10.42.42.10(pid=18245): Launched 12:06:45.442394 tst iperf3.py:8: start network... 12:06:45.652215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:46.189633 run create_hlr_db(pid=18246): Launched 12:06:46.347624 bus /gobi_6: Setting Powered False 12:06:47.409256 run create_hlr_db(pid=18246): Terminated: ok {rc=0} 12:06:47.841520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18248): Launched 12:06:48.154741 run osmo-hlr_10.42.42.2(pid=18249): Launched 12:06:48.272854 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:48.824534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18251): Launched 12:06:49.134705 run osmo-stp_10.42.42.5(pid=18252): Launched 12:06:49.252712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:49.786617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18254): Launched 12:06:49.905919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:50.170412 run patchelf(pid=18255): Launched 12:06:50.343452 run osmo-stp_10.42.42.5(pid=18252): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18252)] 12:06:50.474850 run osmo-stp_10.42.42.5(pid=18252): stdout: | (launched: 2022-12-13_12:06:49.077528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:50.607146 run osmo-stp_10.42.42.5(pid=18252): stderr: | 20221213120649250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120649250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120649251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120649251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120649251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120649252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120649252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:50.739914 run osmo-stp_10.42.42.5(pid=18252): stdout: | (launched: 2022-12-13_12:06:49.077528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:50.866466 run osmo-stp_10.42.42.5(pid=18252): stderr: | 20221213120649250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120649250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120649251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120649251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120649251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120649252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120649252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:51.016589 run patchelf(pid=18255): Terminating (SIGINT) 12:06:51.190286 run patchelf(pid=18255): Terminated: ok {rc=0} 12:06:51.316186 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18252): Process ended prematurely: osmo-stp_10.42.42.5(pid=18252) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18252)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 12:06:51.326020 tst iperf3.py:8: Test FAILED (7.6 sec) 12:06:51.353344 run osmo-hlr_10.42.42.2(pid=18249): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18249)] 12:06:51.401238 run osmo-hlr_10.42.42.2(pid=18249): stdout: | (launched: 2022-12-13_12:06:48.097315) 12:06:51.451093 run osmo-hlr_10.42.42.2(pid=18249): stderr: | 20221213120648275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120648275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120648275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120648275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120648275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120648275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120648288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120648299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120648299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120648299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:51.502102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18244): Terminating (SIGTERM) 12:06:51.542108 run iperf3-srv_10.42.42.10(pid=18245): Terminating (SIGTERM) 12:06:51.581910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18248): Terminating (SIGTERM) 12:06:51.621771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18251): Terminating (SIGTERM) 12:06:51.661667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18254): Terminating (SIGTERM) 12:06:51.701737 --- ParallelTerminationStrategy: PID 18244 died... 12:06:51.721129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18244): Terminated: ok {rc=0} 12:06:51.765269 --- ParallelTerminationStrategy: PID 18245 died... 12:06:51.783776 run iperf3-srv_10.42.42.10(pid=18245): Terminated {rc=256} 12:06:51.827766 --- ParallelTerminationStrategy: PID 18248 died... 12:06:51.846645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18248): Terminated: ok {rc=0} 12:06:51.890426 --- ParallelTerminationStrategy: PID 18251 died... 12:06:51.909158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18251): Terminated: ok {rc=0} 12:06:51.953037 --- ParallelTerminationStrategy: PID 18254 died... 12:06:51.971833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18254): Terminated: ok {rc=0} 12:06:52.057261 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:06:53.206090 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:53.218225 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:06:53.291811 tst iperf3m4.py: using LAC 33831 12:06:53.414438 tst iperf3m4.py: using RAC 171 12:06:53.537424 tst iperf3m4.py: using CellId 33831 12:06:53.660934 tst iperf3m4.py: using BVCI 33832 12:06:53.775127 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:53.786411 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:53.797390 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:53.808281 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:53.819112 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:53.830110 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:53.841225 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:53.851958 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:06:53.862965 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:06:53.985277 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:06:54.105933 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:06:54.228705 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:06:54.349170 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:06:54.558748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:54.870680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18256): Launched 12:06:55.144238 run iperf3-srv_10.42.42.10(pid=18257): Launched 12:06:55.261355 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:06:55.471096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:55.783708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18258): Launched 12:06:56.055586 run iperf3-srv_10.42.42.10(pid=18259): Launched 12:06:56.174911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:06:56.383942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:56.696587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18260): Launched 12:06:56.967851 run iperf3-srv_10.42.42.10(pid=18261): Launched 12:06:57.084573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:06:57.293575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:57.606499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18262): Launched 12:06:57.879939 run iperf3-srv_10.42.42.10(pid=18263): Launched 12:06:57.996760 tst iperf3m4.py:8: start network... 12:06:58.206374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:58.688075 run create_hlr_db(pid=18264): Launched 12:06:58.814903 bus /gobi_6: Setting Powered False 12:06:59.875705 run create_hlr_db(pid=18264): Terminated: ok {rc=0} 12:07:00.309935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18266): Launched 12:07:00.624371 run osmo-hlr_10.42.42.2(pid=18267): Launched 12:07:00.742886 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:01.310658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18269): Launched 12:07:01.642038 run osmo-stp_10.42.42.5(pid=18270): Launched 12:07:01.881996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:02.493711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18272): Launched 12:07:02.613780 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:02.877694 run patchelf(pid=18273): Launched 12:07:03.051616 run osmo-stp_10.42.42.5(pid=18270): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18270)] 12:07:03.184029 run osmo-stp_10.42.42.5(pid=18270): stdout: | (launched: 2022-12-13_12:07:01.582655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:03.318073 run osmo-stp_10.42.42.5(pid=18270): stderr: | 20221213120701912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120701912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120701912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120701921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120701922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120701922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120701922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:03.451720 run osmo-stp_10.42.42.5(pid=18270): stdout: | (launched: 2022-12-13_12:07:01.582655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:03.579572 run osmo-stp_10.42.42.5(pid=18270): stderr: | 20221213120701912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120701912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120701912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120701921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120701922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120701922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120701922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:03.730938 run patchelf(pid=18273): Terminating (SIGINT) 12:07:03.905616 run patchelf(pid=18273): Terminated: ok {rc=0} 12:07:04.031343 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18270): Process ended prematurely: osmo-stp_10.42.42.5(pid=18270) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18270)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:07:04.041128 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:07:04.069100 run osmo-hlr_10.42.42.2(pid=18267): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18267)] 12:07:04.117436 run osmo-hlr_10.42.42.2(pid=18267): stdout: | (launched: 2022-12-13_12:07:00.566973) 12:07:04.167711 run osmo-hlr_10.42.42.2(pid=18267): stderr: | 20221213120700743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120700743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120700743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120700744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120700744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120700744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120700756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120700764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120700765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120700765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:04.218089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18256): Terminating (SIGTERM) 12:07:04.258322 run iperf3-srv_10.42.42.10(pid=18257): Terminating (SIGTERM) 12:07:04.298455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18258): Terminating (SIGTERM) 12:07:04.338968 run iperf3-srv_10.42.42.10(pid=18259): Terminating (SIGTERM) 12:07:04.379192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18260): Terminating (SIGTERM) 12:07:04.419609 run iperf3-srv_10.42.42.10(pid=18261): Terminating (SIGTERM) 12:07:04.459946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18262): Terminating (SIGTERM) 12:07:04.500050 run iperf3-srv_10.42.42.10(pid=18263): Terminating (SIGTERM) 12:07:04.540119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18266): Terminating (SIGTERM) 12:07:04.580348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18269): Terminating (SIGTERM) 12:07:04.620417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18272): Terminating (SIGTERM) 12:07:04.660824 --- ParallelTerminationStrategy: PID 18256 died... 12:07:04.680292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18256): Terminated: ok {rc=0} 12:07:04.724831 --- ParallelTerminationStrategy: PID 18257 died... 12:07:04.744129 run iperf3-srv_10.42.42.10(pid=18257): Terminated {rc=256} 12:07:04.788048 --- ParallelTerminationStrategy: PID 18258 died... 12:07:04.806833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18258): Terminated: ok {rc=0} 12:07:04.851490 --- ParallelTerminationStrategy: PID 18259 died... 12:07:04.870346 run iperf3-srv_10.42.42.10(pid=18259): Terminated {rc=256} 12:07:04.914185 --- ParallelTerminationStrategy: PID 18260 died... 12:07:04.933040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18260): Terminated: ok {rc=0} 12:07:04.977300 --- ParallelTerminationStrategy: PID 18261 died... 12:07:04.996114 run iperf3-srv_10.42.42.10(pid=18261): Terminated {rc=256} 12:07:05.039860 --- ParallelTerminationStrategy: PID 18262 died... 12:07:05.058749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18262): Terminated: ok {rc=0} 12:07:05.103246 --- ParallelTerminationStrategy: PID 18263 died... 12:07:05.122078 run iperf3-srv_10.42.42.10(pid=18263): Terminated {rc=256} 12:07:05.165735 --- ParallelTerminationStrategy: PID 18266 died... 12:07:05.184558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18266): Terminated: ok {rc=0} 12:07:05.228628 --- ParallelTerminationStrategy: PID 18269 died... 12:07:05.247420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18269): Terminated: ok {rc=0} 12:07:05.291452 --- ParallelTerminationStrategy: PID 18272 died... 12:07:05.310226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18272): Terminated: ok {rc=0} 12:07:05.395638 bus /gobi_4: Setting Powered False 12:07:06.496792 bus /gobi_4: Setting Powered False 12:07:07.613623 bus /gobi_1: Setting Powered False 12:07:08.715063 bus /gobi_1: Setting Powered False 12:07:09.832730 bus /gobi_0: Setting Powered False 12:07:10.930920 bus /gobi_0: Setting Powered False 12:07:12.051586 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:07:13.154858 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:13.166977 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:07:13.239052 tst ping.py: using LAC 33832 12:07:13.369372 tst ping.py: using RAC 172 12:07:13.498058 tst ping.py: using CellId 33832 12:07:13.628102 tst ping.py: using BVCI 33833 12:07:13.747114 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:13.758809 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:13.770818 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:13.782400 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:13.794645 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:13.806974 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:13.819000 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:13.830780 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:07:13.947806 tst ping.py:19: start network... 12:07:14.152787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:14.625871 run create_hlr_db(pid=18274): Launched 12:07:14.750320 bus /gobi_6: Setting Powered False 12:07:15.811470 run create_hlr_db(pid=18274): Terminated: ok {rc=0} 12:07:16.274307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18276): Launched 12:07:16.585159 run osmo-hlr_10.42.42.2(pid=18277): Launched 12:07:16.760517 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:17.521985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18279): Launched 12:07:17.851205 run osmo-stp_10.42.42.5(pid=18280): Launched 12:07:17.975419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:18.537388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18282): Launched 12:07:18.663823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:18.939164 run patchelf(pid=18283): Launched 12:07:19.122428 run osmo-stp_10.42.42.5(pid=18280): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18280)] 12:07:19.260351 run osmo-stp_10.42.42.5(pid=18280): stdout: | (launched: 2022-12-13_12:07:17.790867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:19.400268 run osmo-stp_10.42.42.5(pid=18280): stderr: | 20221213120717985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120717985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120717985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120717986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120717986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120717986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120717986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:19.540715 run osmo-stp_10.42.42.5(pid=18280): stdout: | (launched: 2022-12-13_12:07:17.790867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:19.674144 run osmo-stp_10.42.42.5(pid=18280): stderr: | 20221213120717985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120717985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120717985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120717986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120717986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120717986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120717986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:19.832303 run patchelf(pid=18283): Terminating (SIGINT) 12:07:20.014190 run patchelf(pid=18283): Terminated: ok {rc=0} 12:07:20.145009 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18280): Process ended prematurely: osmo-stp_10.42.42.5(pid=18280) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18280)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 12:07:20.154781 tst ping.py:22: Test FAILED (7.0 sec) 12:07:20.182928 run osmo-hlr_10.42.42.2(pid=18277): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18277)] 12:07:20.234091 run osmo-hlr_10.42.42.2(pid=18277): stdout: | (launched: 2022-12-13_12:07:16.528232) 12:07:20.286806 run osmo-hlr_10.42.42.2(pid=18277): stderr: | 20221213120716888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120716888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120716888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120716888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120716888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120716888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120716912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120716929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120716929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120716929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:20.339646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18276): Terminating (SIGTERM) 12:07:20.381638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18279): Terminating (SIGTERM) 12:07:20.424045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18282): Terminating (SIGTERM) 12:07:20.466705 --- ParallelTerminationStrategy: PID 18276 died... 12:07:20.487639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18276): Terminated: ok {rc=0} 12:07:20.534477 --- ParallelTerminationStrategy: PID 18279 died... 12:07:20.554657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18279): Terminated: ok {rc=0} 12:07:20.601379 --- ParallelTerminationStrategy: PID 18282 died... 12:07:20.621649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18282): Terminated: ok {rc=0} 12:07:20.710848 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:07:21.797375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:21.809860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:07:21.884141 tst ping_idle_ping.py: using LAC 33833 12:07:22.013356 tst ping_idle_ping.py: using RAC 173 12:07:22.140349 tst ping_idle_ping.py: using CellId 33833 12:07:22.268033 tst ping_idle_ping.py: using BVCI 33834 12:07:22.386989 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:22.398864 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:22.410354 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:22.421868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:22.433597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:22.445464 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:22.457414 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:22.469089 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:07:22.591537 tst ping_idle_ping.py:24: start network... 12:07:22.812796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:23.326007 run create_hlr_db(pid=18284): Launched 12:07:23.452159 bus /gobi_6: Setting Powered False 12:07:24.513054 run create_hlr_db(pid=18284): Terminated: ok {rc=0} 12:07:24.950039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18286): Launched 12:07:25.256121 run osmo-hlr_10.42.42.2(pid=18287): Launched 12:07:25.373663 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:25.905532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18289): Launched 12:07:26.213297 run osmo-stp_10.42.42.5(pid=18290): Launched 12:07:26.329923 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:26.857616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18292): Launched 12:07:26.974907 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:27.234806 run patchelf(pid=18293): Launched 12:07:27.406226 run osmo-stp_10.42.42.5(pid=18290): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18290)] 12:07:27.535891 run osmo-stp_10.42.42.5(pid=18290): stdout: | (launched: 2022-12-13_12:07:26.156058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:27.666523 run osmo-stp_10.42.42.5(pid=18290): stderr: | 20221213120726329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120726329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120726330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120726330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120726331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120726331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120726331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:27.797186 run osmo-stp_10.42.42.5(pid=18290): stdout: | (launched: 2022-12-13_12:07:26.156058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:27.921552 run osmo-stp_10.42.42.5(pid=18290): stderr: | 20221213120726329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120726329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120726330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120726330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120726331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120726331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120726331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:28.069263 run patchelf(pid=18293): Terminating (SIGINT) 12:07:28.239124 run patchelf(pid=18293): Terminated: ok {rc=0} 12:07:28.362018 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18290): Process ended prematurely: osmo-stp_10.42.42.5(pid=18290) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18290)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:07:28.371143 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:07:28.397907 run osmo-hlr_10.42.42.2(pid=18287): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18287)] 12:07:28.445709 run osmo-hlr_10.42.42.2(pid=18287): stdout: | (launched: 2022-12-13_12:07:25.199013) 12:07:28.495427 run osmo-hlr_10.42.42.2(pid=18287): stderr: | 20221213120725374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120725374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120725374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120725374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120725374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120725374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120725386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120725394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120725394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120725394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:28.545454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18286): Terminating (SIGTERM) 12:07:28.585410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18289): Terminating (SIGTERM) 12:07:28.625290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18292): Terminating (SIGTERM) 12:07:28.665512 --- ParallelTerminationStrategy: PID 18286 died... 12:07:28.684605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18286): Terminated: ok {rc=0} 12:07:28.728984 --- ParallelTerminationStrategy: PID 18289 died... 12:07:28.747667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18289): Terminated: ok {rc=0} 12:07:28.791506 --- ParallelTerminationStrategy: PID 18292 died... 12:07:28.810203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18292): Terminated: ok {rc=0} 12:07:28.893913 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:07:30.209499 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:07:30.216746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:07:30.250805 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:07:30.291577 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:07:30.379862 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:07:30.413582 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:07:30.451744 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:07:31.060496 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:07:31.129168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:31.143533 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:07:31.228832 tst cs_paging_gprs_active.py: using LAC 33834 12:07:31.393283 tst cs_paging_gprs_active.py: using RAC 174 12:07:31.530912 tst cs_paging_gprs_active.py: using CellId 33834 12:07:31.680053 tst cs_paging_gprs_active.py: using BVCI 33835 12:07:31.845554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:31.862885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:31.879336 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:31.896149 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:31.912533 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:31.926842 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:31.946710 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:31.967885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:31.985615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:07:32.109407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:07:32.237462 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:07:32.467573 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:32.804058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18301): Launched 12:07:33.095392 run iperf3-srv_10.42.42.10(pid=18302): Launched 12:07:33.222308 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:07:33.448055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:33.783961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18303): Launched 12:07:34.076495 run iperf3-srv_10.42.42.10(pid=18304): Launched 12:07:34.203028 tst cs_paging_gprs_active.py:38: start network... 12:07:34.428200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:34.943465 run create_hlr_db(pid=18305): Launched 12:07:35.071888 bus /gobi_6: Setting Powered False 12:07:36.136509 run create_hlr_db(pid=18305): Terminated: ok {rc=0} 12:07:36.598865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18307): Launched 12:07:36.931697 run osmo-hlr_10.42.42.2(pid=18308): Launched 12:07:37.061090 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:37.635734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18310): Launched 12:07:37.968269 run osmo-stp_10.42.42.5(pid=18311): Launched 12:07:38.097101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:38.670901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18313): Launched 12:07:38.798167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:39.078758 run patchelf(pid=18314): Launched 12:07:39.265431 run osmo-stp_10.42.42.5(pid=18311): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18311)] 12:07:39.405933 run osmo-stp_10.42.42.5(pid=18311): stdout: | (launched: 2022-12-13_12:07:37.907611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:39.548910 run osmo-stp_10.42.42.5(pid=18311): stderr: | 20221213120738099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120738099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120738099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120738099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120738100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120738100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120738100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:39.691470 run osmo-stp_10.42.42.5(pid=18311): stdout: | (launched: 2022-12-13_12:07:37.907611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:39.826875 run osmo-stp_10.42.42.5(pid=18311): stderr: | 20221213120738099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120738099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120738099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120738099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120738100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120738100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120738100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:39.987879 run patchelf(pid=18314): Terminating (SIGINT) 12:07:40.173186 run patchelf(pid=18314): Terminated: ok {rc=0} 12:07:40.306981 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18311): Process ended prematurely: osmo-stp_10.42.42.5(pid=18311) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18311)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:07:40.317422 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 12:07:40.346000 run osmo-hlr_10.42.42.2(pid=18308): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18308)] 12:07:40.397198 run osmo-hlr_10.42.42.2(pid=18308): stdout: | (launched: 2022-12-13_12:07:36.870785) 12:07:40.449781 run osmo-hlr_10.42.42.2(pid=18308): stderr: | 20221213120737069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120737070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120737070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120737070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120737070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120737070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120737082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120737090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120737090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120737090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:40.503034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18301): Terminating (SIGTERM) 12:07:40.545248 run iperf3-srv_10.42.42.10(pid=18302): Terminating (SIGTERM) 12:07:40.587914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18303): Terminating (SIGTERM) 12:07:40.630211 run iperf3-srv_10.42.42.10(pid=18304): Terminating (SIGTERM) 12:07:40.672776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18307): Terminating (SIGTERM) 12:07:40.715079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18310): Terminating (SIGTERM) 12:07:40.757433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18313): Terminating (SIGTERM) 12:07:40.799778 --- ParallelTerminationStrategy: PID 18301 died... 12:07:40.820201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18301): Terminated: ok {rc=0} 12:07:40.866865 --- ParallelTerminationStrategy: PID 18302 died... 12:07:40.886804 run iperf3-srv_10.42.42.10(pid=18302): Terminated {rc=256} 12:07:40.933278 --- ParallelTerminationStrategy: PID 18303 died... 12:07:40.952871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18303): Terminated: ok {rc=0} 12:07:40.999397 --- ParallelTerminationStrategy: PID 18304 died... 12:07:41.019158 run iperf3-srv_10.42.42.10(pid=18304): Terminated {rc=256} 12:07:41.065518 --- ParallelTerminationStrategy: PID 18307 died... 12:07:41.085309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18307): Terminated: ok {rc=0} 12:07:41.131746 --- ParallelTerminationStrategy: PID 18310 died... 12:07:41.151674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18310): Terminated: ok {rc=0} 12:07:41.197898 --- ParallelTerminationStrategy: PID 18313 died... 12:07:41.217780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18313): Terminated: ok {rc=0} 12:07:41.306305 bus /gobi_0: Setting Powered False 12:07:42.406908 bus /gobi_0: Setting Powered False 12:07:43.522604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:07:44.668323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:44.680232 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:07:44.758718 tst iperf3.py: using LAC 33835 12:07:44.888472 tst iperf3.py: using RAC 175 12:07:45.019874 tst iperf3.py: using CellId 33835 12:07:45.150151 tst iperf3.py: using BVCI 33836 12:07:45.270868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:45.282724 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:45.294255 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:45.305759 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:45.317605 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:45.329428 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:45.341235 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:45.353023 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:45.364865 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:07:45.482680 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:07:45.692938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:46.016128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18315): Launched 12:07:46.297182 run iperf3-srv_10.42.42.10(pid=18316): Launched 12:07:46.433150 tst iperf3.py:8: start network... 12:07:46.648895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:47.142009 run create_hlr_db(pid=18317): Launched 12:07:47.294059 bus /gobi_6: Setting Powered False 12:07:48.355736 run create_hlr_db(pid=18317): Terminated: ok {rc=0} 12:07:48.811410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18319): Launched 12:07:49.145472 run osmo-hlr_10.42.42.2(pid=18320): Launched 12:07:49.273337 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:49.849573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18322): Launched 12:07:50.183901 run osmo-stp_10.42.42.5(pid=18323): Launched 12:07:50.311204 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:50.885673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18325): Launched 12:07:51.014922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:51.297668 run patchelf(pid=18326): Launched 12:07:51.482828 run osmo-stp_10.42.42.5(pid=18323): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18323)] 12:07:51.624755 run osmo-stp_10.42.42.5(pid=18323): stdout: | (launched: 2022-12-13_12:07:50.122912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:51.767476 run osmo-stp_10.42.42.5(pid=18323): stderr: | 20221213120750318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120750318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120750318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120750318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120750319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120750319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120750319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:51.910463 run osmo-stp_10.42.42.5(pid=18323): stdout: | (launched: 2022-12-13_12:07:50.122912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:52.047494 run osmo-stp_10.42.42.5(pid=18323): stderr: | 20221213120750318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120750318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120750318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120750318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120750319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120750319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120750319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:52.209062 run patchelf(pid=18326): Terminating (SIGINT) 12:07:52.395058 run patchelf(pid=18326): Terminated: ok {rc=0} 12:07:52.529539 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18323): Process ended prematurely: osmo-stp_10.42.42.5(pid=18323) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18323)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 12:07:52.539956 tst iperf3.py:8: Test FAILED (7.9 sec) 12:07:52.569121 run osmo-hlr_10.42.42.2(pid=18320): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18320)] 12:07:52.619999 run osmo-hlr_10.42.42.2(pid=18320): stdout: | (launched: 2022-12-13_12:07:49.084352) 12:07:52.672661 run osmo-hlr_10.42.42.2(pid=18320): stderr: | 20221213120749286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120749286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120749286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120749286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120749286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120749286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120749299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120749307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120749308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120749308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:52.725367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18315): Terminating (SIGTERM) 12:07:52.767712 run iperf3-srv_10.42.42.10(pid=18316): Terminating (SIGTERM) 12:07:52.809913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18319): Terminating (SIGTERM) 12:07:52.852206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18322): Terminating (SIGTERM) 12:07:52.894737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18325): Terminating (SIGTERM) 12:07:52.937625 --- ParallelTerminationStrategy: PID 18315 died... 12:07:52.958252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18315): Terminated: ok {rc=0} 12:07:53.005527 --- ParallelTerminationStrategy: PID 18316 died... 12:07:53.025587 run iperf3-srv_10.42.42.10(pid=18316): Terminated {rc=256} 12:07:53.072456 --- ParallelTerminationStrategy: PID 18319 died... 12:07:53.092462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18319): Terminated: ok {rc=0} 12:07:53.139481 --- ParallelTerminationStrategy: PID 18322 died... 12:07:53.159566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18322): Terminated: ok {rc=0} 12:07:53.206617 --- ParallelTerminationStrategy: PID 18325 died... 12:07:53.226718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18325): Terminated: ok {rc=0} 12:07:53.315632 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:07:54.468908 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:54.481371 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:07:54.558093 tst iperf3m4.py: using LAC 33836 12:07:54.690803 tst iperf3m4.py: using RAC 176 12:07:54.821527 tst iperf3m4.py: using CellId 33836 12:07:54.944511 tst iperf3m4.py: using BVCI 33837 12:07:55.058827 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:55.070280 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:55.081519 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:55.092769 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:55.104195 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:55.115660 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:55.127127 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:55.138422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:07:55.149971 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:07:55.271699 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:07:55.393984 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:07:55.517465 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:07:55.635680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:07:55.846321 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:56.159765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18327): Launched 12:07:56.432680 run iperf3-srv_10.42.42.10(pid=18328): Launched 12:07:56.549589 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:07:56.758975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:57.070949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18329): Launched 12:07:57.343977 run iperf3-srv_10.42.42.10(pid=18330): Launched 12:07:57.460350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:07:57.668825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:57.980801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18331): Launched 12:07:58.253618 run iperf3-srv_10.42.42.10(pid=18332): Launched 12:07:58.370492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:07:58.580842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:58.894185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18333): Launched 12:07:59.166836 run iperf3-srv_10.42.42.10(pid=18334): Launched 12:07:59.285152 tst iperf3m4.py:8: start network... 12:07:59.493361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:59.973411 run create_hlr_db(pid=18335): Launched 12:08:00.101047 bus /gobi_6: Setting Powered False 12:08:01.170123 run create_hlr_db(pid=18335): Terminated: ok {rc=0} 12:08:01.644053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18337): Launched 12:08:01.990948 run osmo-hlr_10.42.42.2(pid=18338): Launched 12:08:02.186648 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:02.762789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18340): Launched 12:08:03.094432 run osmo-stp_10.42.42.5(pid=18341): Launched 12:08:03.222255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:03.793310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18343): Launched 12:08:03.921910 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:04.202263 run patchelf(pid=18344): Launched 12:08:04.387044 run osmo-stp_10.42.42.5(pid=18341): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18341)] 12:08:04.528121 run osmo-stp_10.42.42.5(pid=18341): stdout: | (launched: 2022-12-13_12:08:03.033523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:04.669948 run osmo-stp_10.42.42.5(pid=18341): stderr: | 20221213120803222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120803222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120803222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120803223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120803223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120803223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120803223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:04.811992 run osmo-stp_10.42.42.5(pid=18341): stdout: | (launched: 2022-12-13_12:08:03.033523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:04.947617 run osmo-stp_10.42.42.5(pid=18341): stderr: | 20221213120803222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120803222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120803222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120803223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120803223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120803223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120803223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:05.108734 run patchelf(pid=18344): Terminating (SIGINT) 12:08:05.293849 run patchelf(pid=18344): Terminated: ok {rc=0} 12:08:05.427689 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18341): Process ended prematurely: osmo-stp_10.42.42.5(pid=18341) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18341)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:08:05.438456 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:08:05.467857 run osmo-hlr_10.42.42.2(pid=18338): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18338)] 12:08:05.519677 run osmo-hlr_10.42.42.2(pid=18338): stdout: | (launched: 2022-12-13_12:08:01.928997) 12:08:05.572676 run osmo-hlr_10.42.42.2(pid=18338): stderr: | 20221213120802188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120802188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120802188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120802188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120802188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120802188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120802203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120802212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120802212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120802212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:05.625657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18327): Terminating (SIGTERM) 12:08:05.668130 run iperf3-srv_10.42.42.10(pid=18328): Terminating (SIGTERM) 12:08:05.710935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18329): Terminating (SIGTERM) 12:08:05.753746 run iperf3-srv_10.42.42.10(pid=18330): Terminating (SIGTERM) 12:08:05.796328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18331): Terminating (SIGTERM) 12:08:05.839260 run iperf3-srv_10.42.42.10(pid=18332): Terminating (SIGTERM) 12:08:05.881883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18333): Terminating (SIGTERM) 12:08:05.924644 run iperf3-srv_10.42.42.10(pid=18334): Terminating (SIGTERM) 12:08:05.967103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18337): Terminating (SIGTERM) 12:08:06.009935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18340): Terminating (SIGTERM) 12:08:06.052573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18343): Terminating (SIGTERM) 12:08:06.095480 --- ParallelTerminationStrategy: PID 18327 died... 12:08:06.116267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18327): Terminated: ok {rc=0} 12:08:06.163618 --- ParallelTerminationStrategy: PID 18328 died... 12:08:06.183770 run iperf3-srv_10.42.42.10(pid=18328): Terminated {rc=256} 12:08:06.230058 --- ParallelTerminationStrategy: PID 18329 died... 12:08:06.250239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18329): Terminated: ok {rc=0} 12:08:06.297185 --- ParallelTerminationStrategy: PID 18330 died... 12:08:06.317282 run iperf3-srv_10.42.42.10(pid=18330): Terminated {rc=256} 12:08:06.363910 --- ParallelTerminationStrategy: PID 18331 died... 12:08:06.383975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18331): Terminated: ok {rc=0} 12:08:06.430937 --- ParallelTerminationStrategy: PID 18332 died... 12:08:06.450993 run iperf3-srv_10.42.42.10(pid=18332): Terminated {rc=256} 12:08:06.497564 --- ParallelTerminationStrategy: PID 18333 died... 12:08:06.517676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18333): Terminated: ok {rc=0} 12:08:06.565025 --- ParallelTerminationStrategy: PID 18334 died... 12:08:06.585185 run iperf3-srv_10.42.42.10(pid=18334): Terminated {rc=256} 12:08:06.631548 --- ParallelTerminationStrategy: PID 18337 died... 12:08:06.651819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18337): Terminated: ok {rc=0} 12:08:06.698901 --- ParallelTerminationStrategy: PID 18340 died... 12:08:06.719097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18340): Terminated: ok {rc=0} 12:08:06.766077 --- ParallelTerminationStrategy: PID 18343 died... 12:08:06.786364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18343): Terminated: ok {rc=0} 12:08:06.875326 bus /gobi_4: Setting Powered False 12:08:07.976362 bus /gobi_4: Setting Powered False 12:08:09.094040 bus /gobi_1: Setting Powered False 12:08:10.192533 bus /gobi_1: Setting Powered False 12:08:11.308856 bus /gobi_0: Setting Powered False 12:08:12.406751 bus /gobi_0: Setting Powered False 12:08:13.522775 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:08:14.626553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:14.638975 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:08:14.713804 tst ping.py: using LAC 33837 12:08:14.842503 tst ping.py: using RAC 177 12:08:14.970607 tst ping.py: using CellId 33837 12:08:15.099443 tst ping.py: using BVCI 33838 12:08:15.219504 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:15.231262 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:15.242823 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:15.254376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:15.266168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:15.278091 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:15.290068 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:15.301925 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:08:15.422357 tst ping.py:19: start network... 12:08:15.642900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:16.163734 run create_hlr_db(pid=18345): Launched 12:08:16.322045 bus /gobi_6: Setting Powered False 12:08:17.386322 run create_hlr_db(pid=18345): Terminated: ok {rc=0} 12:08:17.841898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18347): Launched 12:08:18.169519 run osmo-hlr_10.42.42.2(pid=18348): Launched 12:08:18.296552 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:18.867888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18350): Launched 12:08:19.195507 run osmo-stp_10.42.42.5(pid=18351): Launched 12:08:19.320592 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:19.884275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18353): Launched 12:08:20.011656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:20.287654 run patchelf(pid=18354): Launched 12:08:20.470590 run osmo-stp_10.42.42.5(pid=18351): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18351)] 12:08:20.609167 run osmo-stp_10.42.42.5(pid=18351): stdout: | (launched: 2022-12-13_12:08:19.134843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:20.748436 run osmo-stp_10.42.42.5(pid=18351): stderr: | 20221213120819326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120819326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120819326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120819327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120819327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120819327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120819327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:20.888161 run osmo-stp_10.42.42.5(pid=18351): stdout: | (launched: 2022-12-13_12:08:19.134843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:21.021835 run osmo-stp_10.42.42.5(pid=18351): stderr: | 20221213120819326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120819326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120819326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120819327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120819327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120819327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120819327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:21.180237 run patchelf(pid=18354): Terminating (SIGINT) 12:08:21.361981 run patchelf(pid=18354): Terminated: ok {rc=0} 12:08:21.493626 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18351): Process ended prematurely: osmo-stp_10.42.42.5(pid=18351) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18351)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 12:08:21.503530 tst ping.py:22: Test FAILED (6.9 sec) 12:08:21.532523 run osmo-hlr_10.42.42.2(pid=18348): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18348)] 12:08:21.583443 run osmo-hlr_10.42.42.2(pid=18348): stdout: | (launched: 2022-12-13_12:08:18.109514) 12:08:21.636265 run osmo-hlr_10.42.42.2(pid=18348): stderr: | 20221213120818307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120818307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120818307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120818307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120818307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120818307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120818320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120818329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120818329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120818329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:21.689127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18347): Terminating (SIGTERM) 12:08:21.731154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18350): Terminating (SIGTERM) 12:08:21.773582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18353): Terminating (SIGTERM) 12:08:21.816087 --- ParallelTerminationStrategy: PID 18347 died... 12:08:21.836609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18347): Terminated: ok {rc=0} 12:08:21.883522 --- ParallelTerminationStrategy: PID 18350 died... 12:08:21.903607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18350): Terminated: ok {rc=0} 12:08:21.950052 --- ParallelTerminationStrategy: PID 18353 died... 12:08:21.969930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18353): Terminated: ok {rc=0} 12:08:22.057984 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:08:23.146097 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:23.158193 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:08:23.232263 tst ping_idle_ping.py: using LAC 33838 12:08:23.353047 tst ping_idle_ping.py: using RAC 178 12:08:23.474544 tst ping_idle_ping.py: using CellId 33838 12:08:23.595859 tst ping_idle_ping.py: using BVCI 33839 12:08:23.707767 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:23.718967 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:23.730082 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:23.741114 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:23.751925 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:23.763096 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:23.774305 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:23.785317 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:08:23.901565 tst ping_idle_ping.py:24: start network... 12:08:24.107142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:24.582595 run create_hlr_db(pid=18355): Launched 12:08:24.709170 bus /gobi_6: Setting Powered False 12:08:25.770295 run create_hlr_db(pid=18355): Terminated: ok {rc=0} 12:08:26.198015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18357): Launched 12:08:26.507334 run osmo-hlr_10.42.42.2(pid=18358): Launched 12:08:26.623297 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:27.150563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18360): Launched 12:08:27.457079 run osmo-stp_10.42.42.5(pid=18361): Launched 12:08:27.575185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:28.135414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18363): Launched 12:08:28.262935 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:28.540854 run patchelf(pid=18364): Launched 12:08:28.725224 run osmo-stp_10.42.42.5(pid=18361): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18361)] 12:08:28.864004 run osmo-stp_10.42.42.5(pid=18361): stdout: | (launched: 2022-12-13_12:08:27.400098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:29.004472 run osmo-stp_10.42.42.5(pid=18361): stderr: | 20221213120827570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120827570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120827570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120827571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120827571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120827571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120827571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:29.145227 run osmo-stp_10.42.42.5(pid=18361): stdout: | (launched: 2022-12-13_12:08:27.400098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:29.279778 run osmo-stp_10.42.42.5(pid=18361): stderr: | 20221213120827570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120827570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120827570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120827571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120827571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120827571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120827571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:29.439597 run patchelf(pid=18364): Terminating (SIGINT) 12:08:29.623115 run patchelf(pid=18364): Terminated: ok {rc=0} 12:08:29.755218 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18361): Process ended prematurely: osmo-stp_10.42.42.5(pid=18361) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18361)] [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:08:29.765130 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:08:29.793394 run osmo-hlr_10.42.42.2(pid=18358): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18358)] 12:08:29.844668 run osmo-hlr_10.42.42.2(pid=18358): stdout: | (launched: 2022-12-13_12:08:26.450628) 12:08:29.897211 run osmo-hlr_10.42.42.2(pid=18358): stderr: | 20221213120826628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120826628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120826629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120826629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120826629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120826629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120826684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120826695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120826696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120826696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:29.949888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18357): Terminating (SIGTERM) 12:08:29.992093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18360): Terminating (SIGTERM) 12:08:30.034712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18363): Terminating (SIGTERM) 12:08:30.077474 --- ParallelTerminationStrategy: PID 18357 died... 12:08:30.098218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18357): Terminated: ok {rc=0} 12:08:30.145271 --- ParallelTerminationStrategy: PID 18360 died... 12:08:30.165539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18360): Terminated: ok {rc=0} 12:08:30.212230 --- ParallelTerminationStrategy: PID 18363 died... 12:08:30.232288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18363): Terminated: ok {rc=0} 12:08:30.323992 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:08:31.641375 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:08:31.650591 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:08:31.692205 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:08:31.738852 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:08:31.803630 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:08:31.839025 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:08:31.876699 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:08:32.436149 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:08:32.442095 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:08:32.454280 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:08:32.529419 tst switch_tch_pdch.py: using LAC 33839 12:08:32.659469 tst switch_tch_pdch.py: using RAC 179 12:08:32.789494 tst switch_tch_pdch.py: using CellId 33839 12:08:32.913889 tst switch_tch_pdch.py: using BVCI 33840 12:08:33.025444 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:08:33.036940 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:08:33.048403 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:08:33.059885 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:08:33.071434 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:08:33.082961 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:08:33.094570 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:08:33.106158 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:08:33.225439 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:08:33.343905 tst switch_tch_pdch.py:51: start network... 12:08:33.548779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:34.020791 run create_hlr_db(pid=18369): Launched 12:08:34.145751 bus /gobi_6: Setting Powered False 12:08:35.206712 run create_hlr_db(pid=18369): Terminated: ok {rc=0} 12:08:35.634037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18371): Launched 12:08:35.939284 run osmo-hlr_10.42.42.2(pid=18372): Launched 12:08:36.055484 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:36.580683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18374): Launched 12:08:36.886248 run osmo-stp_10.42.42.5(pid=18375): Launched 12:08:37.005209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:37.529806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18377): Launched 12:08:37.646621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:37.905373 run patchelf(pid=18378): Launched 12:08:38.074913 run osmo-stp_10.42.42.5(pid=18375): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18375)] 12:08:38.203674 run osmo-stp_10.42.42.5(pid=18375): stdout: | (launched: 2022-12-13_12:08:36.829364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:38.334091 run osmo-stp_10.42.42.5(pid=18375): stderr: | 20221213120837001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120837001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120837001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120837002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120837002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120837002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120837002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:38.464888 run osmo-stp_10.42.42.5(pid=18375): stdout: | (launched: 2022-12-13_12:08:36.829364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:38.589405 run osmo-stp_10.42.42.5(pid=18375): stderr: | 20221213120837001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120837001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120837001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120837002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120837002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120837002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120837002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:38.737504 run patchelf(pid=18378): Terminating (SIGINT) 12:08:38.908360 run patchelf(pid=18378): Terminated: ok {rc=0} 12:08:39.031594 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18375): Process ended prematurely: osmo-stp_10.42.42.5(pid=18375) [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18375)] [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:08:39.040786 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 12:08:39.067465 run osmo-hlr_10.42.42.2(pid=18372): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18372)] 12:08:39.114849 run osmo-hlr_10.42.42.2(pid=18372): stdout: | (launched: 2022-12-13_12:08:35.882701) 12:08:39.164055 run osmo-hlr_10.42.42.2(pid=18372): stderr: | 20221213120836059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120836059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120836059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120836059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120836059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120836059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120836072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120836081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120836081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120836081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:39.213746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18371): Terminating (SIGTERM) 12:08:39.253654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18374): Terminating (SIGTERM) 12:08:39.293573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18377): Terminating (SIGTERM) 12:08:39.333651 --- ParallelTerminationStrategy: PID 18371 died... 12:08:39.353043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18371): Terminated: ok {rc=0} 12:08:39.397489 --- ParallelTerminationStrategy: PID 18374 died... 12:08:39.416308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18374): Terminated: ok {rc=0} 12:08:39.460926 --- ParallelTerminationStrategy: PID 18377 died... 12:08:39.480275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18377): Terminated: ok {rc=0} 12:08:39.565122 bus /gobi_0: Setting Powered False 12:08:40.664216 bus /gobi_0: Setting Powered False 12:08:41.780785 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:08:43.036217 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:08:43.041979 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:08:43.075902 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:08:43.110924 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:08:43.165309 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:08:43.199083 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:08:43.233488 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:08:43.794243 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:08:43.799885 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:08:43.811715 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:08:43.890260 tst switch_tch_pdch.py: using LAC 33840 12:08:44.018939 tst switch_tch_pdch.py: using RAC 180 12:08:44.146853 tst switch_tch_pdch.py: using CellId 33840 12:08:44.276202 tst switch_tch_pdch.py: using BVCI 33841 12:08:44.396514 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:08:44.408335 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:08:44.419814 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:08:44.431265 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:08:44.443109 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:08:44.454971 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:08:44.466941 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:08:44.478658 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:08:44.596300 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:08:44.712818 tst switch_tch_pdch.py:51: start network... 12:08:44.917848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:45.365080 run create_hlr_db(pid=18384): Launched 12:08:45.491266 bus /gobi_6: Setting Powered False 12:08:46.567081 run create_hlr_db(pid=18384): Terminated: ok {rc=0} 12:08:47.117683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18408): Launched 12:08:47.541727 run osmo-hlr_10.42.42.2(pid=18423): Launched 12:08:47.837377 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:48.612453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18507): Launched 12:08:49.023462 run osmo-stp_10.42.42.5(pid=18563): Launched 12:08:49.303765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:50.014481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18661): Launched 12:08:50.150420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:50.431600 run patchelf(pid=18662): Launched 12:08:50.630999 run osmo-stp_10.42.42.5(pid=18563): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18563)] 12:08:50.773535 run osmo-stp_10.42.42.5(pid=18563): stdout: | (launched: 2022-12-13_12:08:48.951654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:50.917240 run osmo-stp_10.42.42.5(pid=18563): stderr: | 20221213120849287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120849288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120849288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120849288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120849293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120849293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120849293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:51.060149 run osmo-stp_10.42.42.5(pid=18563): stdout: | (launched: 2022-12-13_12:08:48.951654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:51.198358 run osmo-stp_10.42.42.5(pid=18563): stderr: | 20221213120849287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120849288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120849288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120849288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120849293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120849293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120849293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:51.361428 run patchelf(pid=18662): Terminating (SIGINT) 12:08:51.550266 run patchelf(pid=18662): Terminated: ok {rc=0} 12:08:51.686962 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18563): Process ended prematurely: osmo-stp_10.42.42.5(pid=18563) [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18563)] [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:08:51.698012 tst switch_tch_pdch.py:54: Test FAILED (7.9 sec) 12:08:51.727519 run osmo-hlr_10.42.42.2(pid=18423): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18423)] 12:08:51.782781 run osmo-hlr_10.42.42.2(pid=18423): stdout: | (launched: 2022-12-13_12:08:47.476742) 12:08:51.837398 run osmo-hlr_10.42.42.2(pid=18423): stderr: | 20221213120847841 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120847841 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120847841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120847841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120847841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120847841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120847855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120847871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120847872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120847872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:51.892258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18408): Terminating (SIGTERM) 12:08:51.936406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18507): Terminating (SIGTERM) 12:08:51.982754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18661): Terminating (SIGTERM) 12:08:52.029723 --- ParallelTerminationStrategy: PID 18408 died... 12:08:52.052109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18408): Terminated: ok {rc=0} 12:08:52.101557 --- ParallelTerminationStrategy: PID 18507 died... 12:08:52.121276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18507): Terminated: ok {rc=0} 12:08:52.166331 --- ParallelTerminationStrategy: PID 18661 died... 12:08:52.185649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18661): Terminated: ok {rc=0} 12:08:52.273734 bus /gobi_0: Setting Powered False 12:08:53.373668 bus /gobi_0: Setting Powered False 12:08:54.491151 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_sms:trx-umtrx --------------------------------------------------------------------- 12:08:55.759934 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:08:55.764547 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:08:55.798481 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 12:08:55.806324 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 12:08:55.859188 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:08:55.893130 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 12:08:55.900892 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 12:08:56.438709 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 12:08:56.445393 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 12:08:56.458292 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 12:08:56.510557 tst mo_mt_sms.py: using LAC 33841 12:08:56.633174 tst mo_mt_sms.py: using RAC 181 12:08:56.757852 tst mo_mt_sms.py: using CellId 33841 12:08:56.881968 tst mo_mt_sms.py: using BVCI 33842 12:08:56.997143 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 12:08:57.116094 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 12:08:57.233369 tst mo_mt_sms.py:9: start nitb and bts... 12:08:57.445882 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:08:58.087145 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18668): Launched 12:08:58.416377 run osmo-nitb_10.42.42.2(pid=18669): Launched 12:08:58.611707 run osmo-nitb_10.42.42.2(pid=18669): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18669)] 12:08:58.753440 run osmo-nitb_10.42.42.2(pid=18669): stdout: | (launched: 2022-12-13_12:08:58.358880) 12:08:58.896498 run osmo-nitb_10.42.42.2(pid=18669): stderr: | (launched: 2022-12-13_12:08:58.404794) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:08:59.039146 run osmo-nitb_10.42.42.2(pid=18669): stdout: | (launched: 2022-12-13_12:08:58.358880) 12:08:59.176218 run osmo-nitb_10.42.42.2(pid=18669): stderr: | (launched: 2022-12-13_12:08:58.404794) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18669): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18669) [trial-2389↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18669)] 12:08:59.556368 tst osmo-nitb_10.42.42.2(pid=18669): stdout: | (launched: 2022-12-13_12:08:58.358880) 12:08:59.693170 tst osmo-nitb_10.42.42.2(pid=18669): stderr: | (launched: 2022-12-13_12:08:58.404794) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:08:59.852864 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18669): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18669) [trial-2389↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18669)] [trial-2389↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 12:08:59.863942 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 12:08:59.871960 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18668): Terminating (SIGTERM) 12:09:00.086714 --- ParallelTerminationStrategy: PID 18668 died... 12:09:00.109537 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18668): Terminated: ok {rc=0} 12:09:00.202948 bus /sierra_3: Setting Powered False 12:09:01.324806 bus /sierra_3: Setting Powered False 12:09:02.486245 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 sms:trx-umtrx --------------------------------------------------------------------- 12:09:03.691458 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:03.696563 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:09:03.731537 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:09:03.760816 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 12:09:03.814036 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:09:03.848477 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:09:03.878771 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 12:09:04.424253 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 12:09:04.430988 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:04.442765 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 12:09:04.497743 tst mo_mt_sms.py: using LAC 33842 12:09:04.623269 tst mo_mt_sms.py: using RAC 182 12:09:04.748816 tst mo_mt_sms.py: using CellId 33842 12:09:04.876084 tst mo_mt_sms.py: using BVCI 33843 12:09:04.992187 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:05.004176 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:05.016096 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:05.027736 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:05.040406 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:05.053194 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 12:09:05.176332 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 12:09:05.295125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:05.783968 run create_hlr_db(pid=18673): Launched 12:09:05.947750 bus /sierra_2: Setting Powered False 12:09:07.010786 run create_hlr_db(pid=18673): Terminated: ok {rc=0} 12:09:07.455070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18675): Launched 12:09:07.786112 run osmo-hlr_10.42.42.2(pid=18676): Launched 12:09:08.027782 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:08.745928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18678): Launched 12:09:09.079093 run osmo-stp_10.42.42.5(pid=18679): Launched 12:09:09.326199 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:09.974748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18681): Launched 12:09:10.303240 run osmo-msc_10.42.42.6(pid=18682): Launched 12:09:10.487061 run osmo-stp_10.42.42.5(pid=18679): ERR: Terminated: ERROR {rc=1} [trial-2389↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18679)] 12:09:10.625414 run osmo-stp_10.42.42.5(pid=18679): stdout: | (launched: 2022-12-13_12:09:09.019804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:10.763543 run osmo-stp_10.42.42.5(pid=18679): stderr: | 20221213120909346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120909346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120909346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120909347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120909347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120909347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120909347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:10.900022 run osmo-stp_10.42.42.5(pid=18679): stdout: | (launched: 2022-12-13_12:09:09.019804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:11.030227 run osmo-stp_10.42.42.5(pid=18679): stderr: | 20221213120909346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120909346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120909346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120909347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120909347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120909347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120909347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:11.186425 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18679): Process ended prematurely: osmo-stp_10.42.42.5(pid=18679) [trial-2389↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18679)] [trial-2389↪sms:trx-umtrx↪mo_mt_sms.py:16] 12:09:11.195663 tst mo_mt_sms.py:16: Test FAILED (6.8 sec) 12:09:11.223472 run osmo-hlr_10.42.42.2(pid=18676): ERR: Terminated: ERROR {rc=237} [trial-2389↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18676)] 12:09:11.274697 run osmo-hlr_10.42.42.2(pid=18676): stdout: | (launched: 2022-12-13_12:09:07.727258) 12:09:11.327585 run osmo-hlr_10.42.42.2(pid=18676): stderr: | 20221213120908069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120908069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120908069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120908069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120908069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120908069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120908083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120908095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120908096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120908096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:11.400726 run osmo-msc_10.42.42.6(pid=18682): ERR: Terminated: ERROR {rc=2} [trial-2389↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18682)] 12:09:11.451397 run osmo-msc_10.42.42.6(pid=18682): stdout: | (launched: 2022-12-13_12:09:10.243491) 12:09:11.503707 run osmo-msc_10.42.42.6(pid=18682): stderr: | 20221213120910564 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120910564 DLGLOBAL DEBUG validating counter group 0x7fcc89ca8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120910564 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120910565 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120910565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120910565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120910567 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120910567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120910567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120910567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:11.556727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18675): Terminating (SIGTERM) 12:09:11.599096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18678): Terminating (SIGTERM) 12:09:11.641422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18681): Terminating (SIGTERM) 12:09:11.684097 --- ParallelTerminationStrategy: PID 18675 died... 12:09:11.704803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18675): Terminated: ok {rc=0} 12:09:11.752123 --- ParallelTerminationStrategy: PID 18678 died... 12:09:11.772266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18678): Terminated: ok {rc=0} 12:09:11.819289 --- ParallelTerminationStrategy: PID 18681 died... 12:09:11.839545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18681): Terminated: ok {rc=0} 12:09:11.928924 bus /sierra_3: Setting Powered False 12:09:13.029704 bus /sierra_3: Setting Powered False 12:09:14.145198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 12:09:15.379031 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:15.383236 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:09:15.417045 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 12:09:15.425117 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 12:09:15.463393 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:09:15.498557 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 12:09:15.505956 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 12:09:16.022628 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 12:09:16.030294 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 12:09:16.045871 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 12:09:16.112396 tst assert_extension.py: using LAC 33843 12:09:16.271807 tst assert_extension.py: using RAC 183 12:09:16.426157 tst assert_extension.py: using CellId 33843 12:09:16.552133 tst assert_extension.py: using BVCI 33844 12:09:16.669396 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 12:09:16.788304 tst assert_extension.py:10: start nitb and bts... 12:09:16.998133 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:09:17.700307 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18687): Launched 12:09:18.029612 run osmo-nitb_10.42.42.2(pid=18688): Launched 12:09:18.211091 run osmo-nitb_10.42.42.2(pid=18688): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18688)] 12:09:18.357413 run osmo-nitb_10.42.42.2(pid=18688): stdout: | (launched: 2022-12-13_12:09:17.969614) 12:09:18.505327 run osmo-nitb_10.42.42.2(pid=18688): stderr: | (launched: 2022-12-13_12:09:18.018046) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:09:18.654095 run osmo-nitb_10.42.42.2(pid=18688): stdout: | (launched: 2022-12-13_12:09:17.969614) 12:09:18.796222 run osmo-nitb_10.42.42.2(pid=18688): stderr: | (launched: 2022-12-13_12:09:18.018046) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18688): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18688) [trial-2389↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18688)] 12:09:19.153335 tst osmo-nitb_10.42.42.2(pid=18688): stdout: | (launched: 2022-12-13_12:09:17.969614) 12:09:19.286650 tst osmo-nitb_10.42.42.2(pid=18688): stderr: | (launched: 2022-12-13_12:09:18.018046) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:09:19.442964 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18688): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18688) [trial-2389↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18688)] [trial-2389↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 12:09:19.452427 tst assert_extension.py:12: Test FAILED (3.4 sec) 12:09:19.459913 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18687): Terminating (SIGTERM) 12:09:19.672321 --- ParallelTerminationStrategy: PID 18687 died... 12:09:19.694022 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18687): Terminated: ok {rc=0} 12:09:19.784072 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 ussd:trx-umtrx --------------------------------------------------------------------- 12:09:20.964165 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:20.969088 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:09:21.002625 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:09:21.030411 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 12:09:21.066041 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:09:21.099517 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:09:21.126820 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 12:09:21.654721 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 12:09:21.659881 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:21.670827 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 12:09:21.719130 tst assert_extension.py: using LAC 33844 12:09:21.838321 tst assert_extension.py: using RAC 184 12:09:21.958445 tst assert_extension.py: using CellId 33844 12:09:22.079467 tst assert_extension.py: using BVCI 33845 12:09:22.191768 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:22.202621 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:22.213255 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:22.223699 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:22.234166 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:09:22.245861 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 12:09:22.364585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:22.870492 run create_hlr_db(pid=18692): Launched 12:09:22.996669 bus /sierra_2: Setting Powered False 12:09:24.061643 run create_hlr_db(pid=18692): Terminated: ok {rc=0} 12:09:24.498543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18694): Launched 12:09:24.805431 run osmo-hlr_10.42.42.2(pid=18695): Launched 12:09:24.923082 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:25.461298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18697): Launched 12:09:25.766082 run osmo-stp_10.42.42.5(pid=18698): Launched 12:09:25.881844 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:26.430368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18700): Launched 12:09:26.733928 run osmo-msc_10.42.42.6(pid=18701): Launched 12:09:26.902969 run osmo-stp_10.42.42.5(pid=18698): ERR: Terminated: ERROR {rc=1} [trial-2389↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18698)] 12:09:27.030235 run osmo-stp_10.42.42.5(pid=18698): stdout: | (launched: 2022-12-13_12:09:25.709884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:27.158020 run osmo-stp_10.42.42.5(pid=18698): stderr: | 20221213120925879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120925879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120925879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120925880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120925880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120925880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120925880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:27.284065 run osmo-stp_10.42.42.5(pid=18698): stdout: | (launched: 2022-12-13_12:09:25.709884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:27.404622 run osmo-stp_10.42.42.5(pid=18698): stderr: | 20221213120925879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120925879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120925879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120925880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120925880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120925880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120925880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:27.548749 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18698): Process ended prematurely: osmo-stp_10.42.42.5(pid=18698) [trial-2389↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18698)] [trial-2389↪ussd:trx-umtrx↪assert_extension.py:17] 12:09:27.557470 tst assert_extension.py:17: Test FAILED (5.9 sec) 12:09:27.583729 run osmo-hlr_10.42.42.2(pid=18695): ERR: Terminated: ERROR {rc=237} [trial-2389↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18695)] 12:09:27.631727 run osmo-hlr_10.42.42.2(pid=18695): stdout: | (launched: 2022-12-13_12:09:24.748688) 12:09:27.681548 run osmo-hlr_10.42.42.2(pid=18695): stderr: | 20221213120924926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120924926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120924926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120924926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120924926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120924926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120924938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120924946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120924947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120924947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:27.751054 run osmo-msc_10.42.42.6(pid=18701): ERR: Terminated: ERROR {rc=2} [trial-2389↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18701)] 12:09:27.798635 run osmo-msc_10.42.42.6(pid=18701): stdout: | (launched: 2022-12-13_12:09:26.677769) 12:09:27.847980 run osmo-msc_10.42.42.6(pid=18701): stderr: | 20221213120926948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120926948 DLGLOBAL DEBUG validating counter group 0x7fe8b0190c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120926948 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120926948 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120926948 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120926949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120926950 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120926951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120926951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120926951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:27.897681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18694): Terminating (SIGTERM) 12:09:27.937481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18697): Terminating (SIGTERM) 12:09:27.977313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18700): Terminating (SIGTERM) 12:09:28.017541 --- ParallelTerminationStrategy: PID 18694 died... 12:09:28.036589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18694): Terminated: ok {rc=0} 12:09:28.080455 --- ParallelTerminationStrategy: PID 18697 died... 12:09:28.099048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18697): Terminated: ok {rc=0} 12:09:28.142927 --- ParallelTerminationStrategy: PID 18700 died... 12:09:28.161664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18700): Terminated: ok {rc=0} 12:09:28.245310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:09:29.452611 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:29.459239 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:09:29.491775 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:09:29.519253 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:09:29.573447 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:09:29.607749 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:09:29.635726 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:09:30.185944 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:09:30.241836 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:30.253881 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:09:30.324597 tst mo_mt_call.py: using LAC 33845 12:09:30.453454 tst mo_mt_call.py: using RAC 185 12:09:30.577399 tst mo_mt_call.py: using CellId 33845 12:09:30.699162 tst mo_mt_call.py: using BVCI 33846 12:09:30.812656 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:30.824088 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:30.840319 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:30.852732 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:30.865071 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:30.880464 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:09:31.023029 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:09:31.141471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:31.631802 run create_hlr_db(pid=18706): Launched 12:09:31.786590 bus /sierra_2: Setting Powered False 12:09:32.849125 run create_hlr_db(pid=18706): Terminated: ok {rc=0} 12:09:33.282432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18708): Launched 12:09:33.595059 run osmo-hlr_10.42.42.2(pid=18709): Launched 12:09:33.713697 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:34.250243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18711): Launched 12:09:34.563262 run osmo-stp_10.42.42.5(pid=18712): Launched 12:09:34.683832 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:35.245745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18714): Launched 12:09:35.558041 run osmo-msc_10.42.42.6(pid=18715): Launched 12:09:35.734510 run osmo-stp_10.42.42.5(pid=18712): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18712)] 12:09:35.866517 run osmo-stp_10.42.42.5(pid=18712): stdout: | (launched: 2022-12-13_12:09:34.505787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:35.997480 run osmo-stp_10.42.42.5(pid=18712): stderr: | 20221213120934678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120934678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120934678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120934678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120934679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120934679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120934679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:36.126656 run osmo-stp_10.42.42.5(pid=18712): stdout: | (launched: 2022-12-13_12:09:34.505787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:36.250329 run osmo-stp_10.42.42.5(pid=18712): stderr: | 20221213120934678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120934678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120934678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120934678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120934679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120934679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120934679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:36.398568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18712): Process ended prematurely: osmo-stp_10.42.42.5(pid=18712) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18712)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:09:36.407921 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:09:36.434829 run osmo-hlr_10.42.42.2(pid=18709): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18709)] 12:09:36.483331 run osmo-hlr_10.42.42.2(pid=18709): stdout: | (launched: 2022-12-13_12:09:33.537563) 12:09:36.533736 run osmo-hlr_10.42.42.2(pid=18709): stderr: | 20221213120933713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120933713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120933713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120933713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120933713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120933713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120933731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120933741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120933741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120933741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:36.603869 run osmo-msc_10.42.42.6(pid=18715): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18715)] 12:09:36.651896 run osmo-msc_10.42.42.6(pid=18715): stdout: | (launched: 2022-12-13_12:09:35.500305) 12:09:36.702089 run osmo-msc_10.42.42.6(pid=18715): stderr: | 20221213120935772 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120935773 DLGLOBAL DEBUG validating counter group 0x7faf2c25ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120935773 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120935773 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120935773 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120935773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120935775 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120935775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120935775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120935775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:36.752501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18708): Terminating (SIGTERM) 12:09:36.792584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18711): Terminating (SIGTERM) 12:09:36.833160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18714): Terminating (SIGTERM) 12:09:36.874084 --- ParallelTerminationStrategy: PID 18708 died... 12:09:36.893625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18708): Terminated: ok {rc=0} 12:09:36.938091 --- ParallelTerminationStrategy: PID 18711 died... 12:09:36.956829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18711): Terminated: ok {rc=0} 12:09:37.001216 --- ParallelTerminationStrategy: PID 18714 died... 12:09:37.019975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18714): Terminated: ok {rc=0} 12:09:37.103949 bus /sierra_3: Setting Powered False 12:09:38.202628 bus /sierra_3: Setting Powered False 12:09:39.320585 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:09:40.472438 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:40.485162 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:09:40.561075 tst mo_mt_call_osmux.py: using LAC 33846 12:09:40.691255 tst mo_mt_call_osmux.py: using RAC 186 12:09:40.821678 tst mo_mt_call_osmux.py: using CellId 33846 12:09:40.943633 tst mo_mt_call_osmux.py: using BVCI 33847 12:09:41.058284 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:41.069770 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:41.081037 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:41.092185 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:41.103718 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:09:41.114841 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:09:41.231798 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:09:41.354852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:41.870227 run create_hlr_db(pid=18717): Launched 12:09:41.998839 bus /sierra_2: Setting Powered False 12:09:43.063981 run create_hlr_db(pid=18717): Terminated: ok {rc=0} 12:09:43.508135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18719): Launched 12:09:43.819234 run osmo-hlr_10.42.42.2(pid=18720): Launched 12:09:43.937195 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:44.475968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18722): Launched 12:09:44.787370 run osmo-stp_10.42.42.5(pid=18723): Launched 12:09:44.906665 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:45.469406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18725): Launched 12:09:45.782731 run osmo-msc_10.42.42.6(pid=18726): Launched 12:09:46.119943 run osmo-stp_10.42.42.5(pid=18723): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18723)] 12:09:46.406440 run osmo-stp_10.42.42.5(pid=18723): stdout: | (launched: 2022-12-13_12:09:44.729998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:46.551486 run osmo-stp_10.42.42.5(pid=18723): stderr: | 20221213120944901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120944901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120944901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120944902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120944902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120944902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120944902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:46.690999 run osmo-stp_10.42.42.5(pid=18723): stdout: | (launched: 2022-12-13_12:09:44.729998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:46.818529 run osmo-stp_10.42.42.5(pid=18723): stderr: | 20221213120944901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120944901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120944901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120944902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120944902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120944902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120944902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:46.969290 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18723): Process ended prematurely: osmo-stp_10.42.42.5(pid=18723) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18723)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:09:46.979497 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:09:47.007674 run osmo-hlr_10.42.42.2(pid=18720): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18720)] 12:09:47.057857 run osmo-hlr_10.42.42.2(pid=18720): stdout: | (launched: 2022-12-13_12:09:43.762167) 12:09:47.109623 run osmo-hlr_10.42.42.2(pid=18720): stderr: | 20221213120943940 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120943940 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120943940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120943940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120943940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120943940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120943953 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120943962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120943962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120943962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:47.181013 run osmo-msc_10.42.42.6(pid=18726): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18726)] 12:09:47.230740 run osmo-msc_10.42.42.6(pid=18726): stdout: | (launched: 2022-12-13_12:09:45.725220) 12:09:47.282510 run osmo-msc_10.42.42.6(pid=18726): stderr: | 20221213120946101 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120946101 DLGLOBAL DEBUG validating counter group 0x7fcada247c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120946101 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120946101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120946101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120946102 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120946106 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120946108 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120946108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120946108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:47.333813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18719): Terminating (SIGTERM) 12:09:47.374893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18722): Terminating (SIGTERM) 12:09:47.415704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18725): Terminating (SIGTERM) 12:09:47.457277 --- ParallelTerminationStrategy: PID 18719 died... 12:09:47.476900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18719): Terminated: ok {rc=0} 12:09:47.522482 --- ParallelTerminationStrategy: PID 18722 died... 12:09:47.541804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18722): Terminated: ok {rc=0} 12:09:47.586869 --- ParallelTerminationStrategy: PID 18725 died... 12:09:47.606153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18725): Terminated: ok {rc=0} 12:09:47.692459 bus /sierra_3: Setting Powered False 12:09:48.791933 bus /sierra_3: Setting Powered False 12:09:49.912567 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:09:51.172321 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:51.179668 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:09:51.214357 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:09:51.242418 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:09:51.296832 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:09:51.330735 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:09:51.358916 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:09:51.907909 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:09:51.958159 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:09:51.969743 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:09:52.039694 tst mo_mt_call.py: using LAC 33847 12:09:52.165965 tst mo_mt_call.py: using RAC 187 12:09:52.286279 tst mo_mt_call.py: using CellId 33847 12:09:52.406390 tst mo_mt_call.py: using BVCI 33848 12:09:52.519704 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:09:52.531038 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:09:52.542148 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:09:52.553280 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:09:52.564384 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:09:52.575557 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:09:52.696343 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:09:52.815005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:53.295782 run create_hlr_db(pid=18731): Launched 12:09:53.422304 bus /sierra_2: Setting Powered False 12:09:54.484550 run create_hlr_db(pid=18731): Terminated: ok {rc=0} 12:09:54.939849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18733): Launched 12:09:55.275527 run osmo-hlr_10.42.42.2(pid=18734): Launched 12:09:55.403500 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:55.982055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18736): Launched 12:09:56.315804 run osmo-stp_10.42.42.5(pid=18737): Launched 12:09:56.443192 run osmo-msc_10.42.42.6: Starting osmo-msc 12:09:57.044572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18739): Launched 12:09:57.377208 run osmo-msc_10.42.42.6(pid=18740): Launched 12:09:57.566487 run osmo-stp_10.42.42.5(pid=18737): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18737)] 12:09:57.707249 run osmo-stp_10.42.42.5(pid=18737): stdout: | (launched: 2022-12-13_12:09:56.255267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:57.847676 run osmo-stp_10.42.42.5(pid=18737): stderr: | 20221213120956445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120956445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120956446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120956446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120956446 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120956447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120956447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:57.986587 run osmo-stp_10.42.42.5(pid=18737): stdout: | (launched: 2022-12-13_12:09:56.255267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:58.118884 run osmo-stp_10.42.42.5(pid=18737): stderr: | 20221213120956445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213120956445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213120956446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213120956446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213120956446 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213120956447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213120956447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:58.277103 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18737): Process ended prematurely: osmo-stp_10.42.42.5(pid=18737) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18737)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:09:58.286986 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:09:58.315493 run osmo-hlr_10.42.42.2(pid=18734): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18734)] 12:09:58.367190 run osmo-hlr_10.42.42.2(pid=18734): stdout: | (launched: 2022-12-13_12:09:55.214619) 12:09:58.420096 run osmo-hlr_10.42.42.2(pid=18734): stderr: | 20221213120955412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213120955412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213120955412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213120955412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213120955412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213120955412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213120955425 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213120955434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213120955434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213120955434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:58.493731 run osmo-msc_10.42.42.6(pid=18740): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18740)] 12:09:58.544513 run osmo-msc_10.42.42.6(pid=18740): stdout: | (launched: 2022-12-13_12:09:57.315811) 12:09:58.598068 run osmo-msc_10.42.42.6(pid=18740): stderr: | 20221213120957638 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213120957638 DLGLOBAL DEBUG validating counter group 0x7f1ef37b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213120957638 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213120957638 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213120957638 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213120957639 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213120957640 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213120957641 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213120957641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213120957641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:09:58.651125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18733): Terminating (SIGTERM) 12:09:58.693431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18736): Terminating (SIGTERM) 12:09:58.736067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18739): Terminating (SIGTERM) 12:09:58.779070 --- ParallelTerminationStrategy: PID 18733 died... 12:09:58.799999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18733): Terminated: ok {rc=0} 12:09:58.847311 --- ParallelTerminationStrategy: PID 18736 died... 12:09:58.867534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18736): Terminated: ok {rc=0} 12:09:58.914662 --- ParallelTerminationStrategy: PID 18739 died... 12:09:58.934840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18739): Terminated: ok {rc=0} 12:09:59.024685 bus /sierra_3: Setting Powered False 12:10:00.122778 bus /sierra_3: Setting Powered False 12:10:01.265305 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:10:02.430227 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:10:02.442967 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:10:02.517637 tst mo_mt_call_osmux.py: using LAC 33848 12:10:02.641543 tst mo_mt_call_osmux.py: using RAC 188 12:10:02.774252 tst mo_mt_call_osmux.py: using CellId 33848 12:10:02.906044 tst mo_mt_call_osmux.py: using BVCI 33849 12:10:03.027428 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:10:03.039545 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:10:03.051313 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:10:03.063099 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:10:03.075332 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:10:03.087441 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:10:03.206460 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:10:03.327559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:03.810035 run create_hlr_db(pid=18745): Launched 12:10:03.940214 bus /sierra_2: Setting Powered False 12:10:05.001765 run create_hlr_db(pid=18745): Terminated: ok {rc=0} 12:10:05.455552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18747): Launched 12:10:05.789892 run osmo-hlr_10.42.42.2(pid=18748): Launched 12:10:05.918642 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:06.493754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18750): Launched 12:10:06.827285 run osmo-stp_10.42.42.5(pid=18751): Launched 12:10:06.955338 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:07.554951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18753): Launched 12:10:07.888661 run osmo-msc_10.42.42.6(pid=18754): Launched 12:10:08.075179 run osmo-stp_10.42.42.5(pid=18751): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18751)] 12:10:08.215206 run osmo-stp_10.42.42.5(pid=18751): stdout: | (launched: 2022-12-13_12:10:06.766852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:08.355570 run osmo-stp_10.42.42.5(pid=18751): stderr: | 20221213121006957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121006958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121006958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121006958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121006959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121006959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121006959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:08.494068 run osmo-stp_10.42.42.5(pid=18751): stdout: | (launched: 2022-12-13_12:10:06.766852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:08.626604 run osmo-stp_10.42.42.5(pid=18751): stderr: | 20221213121006957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121006958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121006958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121006958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121006959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121006959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121006959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:08.784346 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18751): Process ended prematurely: osmo-stp_10.42.42.5(pid=18751) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18751)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:10:08.794505 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:10:08.822558 run osmo-hlr_10.42.42.2(pid=18748): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18748)] 12:10:08.874155 run osmo-hlr_10.42.42.2(pid=18748): stdout: | (launched: 2022-12-13_12:10:05.729251) 12:10:08.926909 run osmo-hlr_10.42.42.2(pid=18748): stderr: | 20221213121005928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121005928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121005928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121005928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121005928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121005928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121005950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121005959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121005959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121005959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:08.999837 run osmo-msc_10.42.42.6(pid=18754): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18754)] 12:10:09.049845 run osmo-msc_10.42.42.6(pid=18754): stdout: | (launched: 2022-12-13_12:10:07.827730) 12:10:09.102652 run osmo-msc_10.42.42.6(pid=18754): stderr: | 20221213121008150 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121008151 DLGLOBAL DEBUG validating counter group 0x7ff4d2c57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121008151 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121008151 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121008151 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121008151 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121008153 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121008153 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121008153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121008154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:09.154866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18747): Terminating (SIGTERM) 12:10:09.196775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18750): Terminating (SIGTERM) 12:10:09.239068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18753): Terminating (SIGTERM) 12:10:09.281735 --- ParallelTerminationStrategy: PID 18747 died... 12:10:09.302462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18747): Terminated: ok {rc=0} 12:10:09.349398 --- ParallelTerminationStrategy: PID 18750 died... 12:10:09.369708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18750): Terminated: ok {rc=0} 12:10:09.416217 --- ParallelTerminationStrategy: PID 18753 died... 12:10:09.436460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18753): Terminated: ok {rc=0} 12:10:09.526358 bus /sierra_3: Setting Powered False 12:10:10.625475 bus /sierra_3: Setting Powered False 12:10:11.741393 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:10:12.991584 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:12.997918 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:10:13.030372 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:10:13.057564 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:10:13.108501 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:10:13.140917 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:10:13.167972 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:10:13.722665 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:10:13.772593 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:13.784035 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:10:13.851890 tst mo_mt_call.py: using LAC 33849 12:10:13.973147 tst mo_mt_call.py: using RAC 189 12:10:14.093743 tst mo_mt_call.py: using CellId 33849 12:10:14.214570 tst mo_mt_call.py: using BVCI 33850 12:10:14.326904 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:14.338200 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:14.349356 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:14.360423 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:14.371584 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:14.382594 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:10:14.503616 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:10:14.621860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:15.104901 run create_hlr_db(pid=18759): Launched 12:10:15.232610 bus /sierra_2: Setting Powered False 12:10:16.295392 run create_hlr_db(pid=18759): Terminated: ok {rc=0} 12:10:16.739674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18761): Launched 12:10:17.069933 run osmo-hlr_10.42.42.2(pid=18762): Launched 12:10:17.243882 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:17.793789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18764): Launched 12:10:18.106568 run osmo-stp_10.42.42.5(pid=18765): Launched 12:10:18.226337 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:18.786996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18767): Launched 12:10:19.100705 run osmo-msc_10.42.42.6(pid=18768): Launched 12:10:19.275473 run osmo-stp_10.42.42.5(pid=18765): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18765)] 12:10:19.406891 run osmo-stp_10.42.42.5(pid=18765): stdout: | (launched: 2022-12-13_12:10:18.049068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:19.538200 run osmo-stp_10.42.42.5(pid=18765): stderr: | 20221213121018218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121018218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121018219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121018219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121018220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121018220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121018220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:19.667449 run osmo-stp_10.42.42.5(pid=18765): stdout: | (launched: 2022-12-13_12:10:18.049068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:19.791912 run osmo-stp_10.42.42.5(pid=18765): stderr: | 20221213121018218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121018218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121018219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121018219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121018220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121018220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121018220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:19.939819 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18765): Process ended prematurely: osmo-stp_10.42.42.5(pid=18765) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18765)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:10:19.949183 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:10:19.976159 run osmo-hlr_10.42.42.2(pid=18762): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18762)] 12:10:20.024734 run osmo-hlr_10.42.42.2(pid=18762): stdout: | (launched: 2022-12-13_12:10:17.011701) 12:10:20.075124 run osmo-hlr_10.42.42.2(pid=18762): stderr: | 20221213121017253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121017253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121017253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121017253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121017254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121017254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121017266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121017275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121017276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121017276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:20.145442 run osmo-msc_10.42.42.6(pid=18768): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18768)] 12:10:20.193559 run osmo-msc_10.42.42.6(pid=18768): stdout: | (launched: 2022-12-13_12:10:19.043107) 12:10:20.243525 run osmo-msc_10.42.42.6(pid=18768): stderr: | 20221213121019316 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121019317 DLGLOBAL DEBUG validating counter group 0x7fac92291c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121019317 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121019317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121019317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121019317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121019319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121019319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121019319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121019320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:20.293757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18761): Terminating (SIGTERM) 12:10:20.334339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18764): Terminating (SIGTERM) 12:10:20.374894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18767): Terminating (SIGTERM) 12:10:20.415705 --- ParallelTerminationStrategy: PID 18761 died... 12:10:20.435540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18761): Terminated: ok {rc=0} 12:10:20.480505 --- ParallelTerminationStrategy: PID 18764 died... 12:10:20.499752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18764): Terminated: ok {rc=0} 12:10:20.544348 --- ParallelTerminationStrategy: PID 18767 died... 12:10:20.563634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18767): Terminated: ok {rc=0} 12:10:20.652238 bus /sierra_3: Setting Powered False 12:10:21.753450 bus /sierra_3: Setting Powered False 12:10:22.870910 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:10:24.020705 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:24.032842 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:10:24.103182 tst mo_mt_call_osmux.py: using LAC 33850 12:10:24.225338 tst mo_mt_call_osmux.py: using RAC 190 12:10:24.347714 tst mo_mt_call_osmux.py: using CellId 33850 12:10:24.471558 tst mo_mt_call_osmux.py: using BVCI 33851 12:10:24.584348 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:24.595841 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:24.607084 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:24.618312 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:24.629553 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:10:24.640538 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:10:24.762811 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:10:24.882641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:25.366359 run create_hlr_db(pid=18770): Launched 12:10:25.496523 bus /sierra_2: Setting Powered False 12:10:26.558268 run create_hlr_db(pid=18770): Terminated: ok {rc=0} 12:10:27.004379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18772): Launched 12:10:27.331129 run osmo-hlr_10.42.42.2(pid=18773): Launched 12:10:27.455967 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:28.022702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18775): Launched 12:10:28.332155 run osmo-stp_10.42.42.5(pid=18776): Launched 12:10:28.447302 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:28.994831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18778): Launched 12:10:29.298023 run osmo-msc_10.42.42.6(pid=18779): Launched 12:10:29.466283 run osmo-stp_10.42.42.5(pid=18776): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18776)] 12:10:29.593746 run osmo-stp_10.42.42.5(pid=18776): stdout: | (launched: 2022-12-13_12:10:28.275883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:29.720696 run osmo-stp_10.42.42.5(pid=18776): stderr: | 20221213121028443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121028443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121028443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121028444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121028444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121028444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121028444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:29.847674 run osmo-stp_10.42.42.5(pid=18776): stdout: | (launched: 2022-12-13_12:10:28.275883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:29.968018 run osmo-stp_10.42.42.5(pid=18776): stderr: | 20221213121028443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121028443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121028443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121028444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121028444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121028444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121028444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:30.112269 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18776): Process ended prematurely: osmo-stp_10.42.42.5(pid=18776) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18776)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:10:30.121427 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:10:30.147902 run osmo-hlr_10.42.42.2(pid=18773): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18773)] 12:10:30.195564 run osmo-hlr_10.42.42.2(pid=18773): stdout: | (launched: 2022-12-13_12:10:27.271654) 12:10:30.245223 run osmo-hlr_10.42.42.2(pid=18773): stderr: | 20221213121027464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121027464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121027464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121027464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121027464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121027464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121027476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121027486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121027486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121027486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:30.314347 run osmo-msc_10.42.42.6(pid=18779): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18779)] 12:10:30.362040 run osmo-msc_10.42.42.6(pid=18779): stdout: | (launched: 2022-12-13_12:10:29.242448) 12:10:30.411132 run osmo-msc_10.42.42.6(pid=18779): stderr: | 20221213121029511 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121029511 DLGLOBAL DEBUG validating counter group 0x7fb7bff0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121029511 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121029511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121029511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121029512 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121029513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121029514 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121029514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121029514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:30.461257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18772): Terminating (SIGTERM) 12:10:30.500771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18775): Terminating (SIGTERM) 12:10:30.540440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18778): Terminating (SIGTERM) 12:10:30.580379 --- ParallelTerminationStrategy: PID 18772 died... 12:10:30.599696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18772): Terminated: ok {rc=0} 12:10:30.643627 --- ParallelTerminationStrategy: PID 18775 died... 12:10:30.662519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18775): Terminated: ok {rc=0} 12:10:30.706463 --- ParallelTerminationStrategy: PID 18778 died... 12:10:30.725390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18778): Terminated: ok {rc=0} 12:10:30.811547 bus /sierra_3: Setting Powered False 12:10:31.935032 bus /sierra_3: Setting Powered False 12:10:33.048832 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:10:34.297797 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:34.304341 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:10:34.336503 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:10:34.363227 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:10:34.415530 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:10:34.449097 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:10:34.475679 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:10:35.024406 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:10:35.073450 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:35.084729 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:10:35.153380 tst mo_mt_call.py: using LAC 33851 12:10:35.273201 tst mo_mt_call.py: using RAC 191 12:10:35.393533 tst mo_mt_call.py: using CellId 33851 12:10:35.522423 tst mo_mt_call.py: using BVCI 33852 12:10:35.642879 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:35.654620 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:35.666301 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:35.677949 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:35.689905 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:35.701567 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:10:35.818051 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:10:35.935398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:36.406131 run create_hlr_db(pid=18784): Launched 12:10:36.531076 bus /sierra_2: Setting Powered False 12:10:37.591402 run create_hlr_db(pid=18784): Terminated: ok {rc=0} 12:10:38.016643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18786): Launched 12:10:38.321340 run osmo-hlr_10.42.42.2(pid=18787): Launched 12:10:38.436707 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:38.958760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18789): Launched 12:10:39.264048 run osmo-stp_10.42.42.5(pid=18790): Launched 12:10:39.379732 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:39.930414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18792): Launched 12:10:40.235122 run osmo-msc_10.42.42.6(pid=18793): Launched 12:10:40.404273 run osmo-stp_10.42.42.5(pid=18790): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18790)] 12:10:40.532470 run osmo-stp_10.42.42.5(pid=18790): stdout: | (launched: 2022-12-13_12:10:39.207707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:40.662507 run osmo-stp_10.42.42.5(pid=18790): stderr: | 20221213121039377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121039377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121039377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121039377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121039378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121039378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121039378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:40.789227 run osmo-stp_10.42.42.5(pid=18790): stdout: | (launched: 2022-12-13_12:10:39.207707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:40.910401 run osmo-stp_10.42.42.5(pid=18790): stderr: | 20221213121039377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121039377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121039377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121039377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121039378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121039378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121039378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:41.055546 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18790): Process ended prematurely: osmo-stp_10.42.42.5(pid=18790) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18790)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:10:41.064542 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:10:41.091264 run osmo-hlr_10.42.42.2(pid=18787): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18787)] 12:10:41.139694 run osmo-hlr_10.42.42.2(pid=18787): stdout: | (launched: 2022-12-13_12:10:38.265556) 12:10:41.189918 run osmo-hlr_10.42.42.2(pid=18787): stderr: | 20221213121038438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121038438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121038438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121038438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121038439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121038439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121038451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121038460 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121038460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121038460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:41.259766 run osmo-msc_10.42.42.6(pid=18793): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18793)] 12:10:41.307634 run osmo-msc_10.42.42.6(pid=18793): stdout: | (launched: 2022-12-13_12:10:40.179253) 12:10:41.357375 run osmo-msc_10.42.42.6(pid=18793): stderr: | 20221213121040448 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121040449 DLGLOBAL DEBUG validating counter group 0x7fbab15f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121040449 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121040449 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121040449 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121040449 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121040451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121040451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121040452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121040452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:41.407554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18786): Terminating (SIGTERM) 12:10:41.447386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18789): Terminating (SIGTERM) 12:10:41.487328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18792): Terminating (SIGTERM) 12:10:41.527664 --- ParallelTerminationStrategy: PID 18786 died... 12:10:41.546898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18786): Terminated: ok {rc=0} 12:10:41.591042 --- ParallelTerminationStrategy: PID 18789 died... 12:10:41.609975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18789): Terminated: ok {rc=0} 12:10:41.654046 --- ParallelTerminationStrategy: PID 18792 died... 12:10:41.672920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18792): Terminated: ok {rc=0} 12:10:41.759449 bus /sierra_3: Setting Powered False 12:10:42.859209 bus /sierra_3: Setting Powered False 12:10:43.975183 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:10:45.119949 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:45.131778 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:10:45.201064 tst mo_mt_call_osmux.py: using LAC 33852 12:10:45.322539 tst mo_mt_call_osmux.py: using RAC 192 12:10:45.443715 tst mo_mt_call_osmux.py: using CellId 33852 12:10:45.564653 tst mo_mt_call_osmux.py: using BVCI 33853 12:10:45.686135 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:45.697911 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:45.709592 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:45.721132 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:45.733670 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:10:45.746069 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:10:45.880078 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:10:46.000224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:46.523290 run create_hlr_db(pid=18795): Launched 12:10:46.682737 bus /sierra_2: Setting Powered False 12:10:47.747199 run create_hlr_db(pid=18795): Terminated: ok {rc=0} 12:10:48.201663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18797): Launched 12:10:48.528512 run osmo-hlr_10.42.42.2(pid=18798): Launched 12:10:48.654243 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:49.218424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18800): Launched 12:10:49.545193 run osmo-stp_10.42.42.5(pid=18801): Launched 12:10:49.670934 run osmo-msc_10.42.42.6: Starting osmo-msc 12:10:50.259472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18803): Launched 12:10:50.585220 run osmo-msc_10.42.42.6(pid=18804): Launched 12:10:50.767803 run osmo-stp_10.42.42.5(pid=18801): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18801)] 12:10:50.908790 run osmo-stp_10.42.42.5(pid=18801): stdout: | (launched: 2022-12-13_12:10:49.485621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:51.045230 run osmo-stp_10.42.42.5(pid=18801): stderr: | 20221213121049674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121049674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121049674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121049675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121049675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121049675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121049675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:51.182079 run osmo-stp_10.42.42.5(pid=18801): stdout: | (launched: 2022-12-13_12:10:49.485621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:51.311881 run osmo-stp_10.42.42.5(pid=18801): stderr: | 20221213121049674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121049674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121049674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121049675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121049675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121049675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121049675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:51.467524 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18801): Process ended prematurely: osmo-stp_10.42.42.5(pid=18801) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18801)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:10:51.477424 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:10:51.505587 run osmo-hlr_10.42.42.2(pid=18798): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18798)] 12:10:51.556890 run osmo-hlr_10.42.42.2(pid=18798): stdout: | (launched: 2022-12-13_12:10:48.469093) 12:10:51.610261 run osmo-hlr_10.42.42.2(pid=18798): stderr: | 20221213121048663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121048663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121048663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121048663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121048663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121048663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121048675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121048684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121048684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121048684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:51.683325 run osmo-msc_10.42.42.6(pid=18804): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18804)] 12:10:51.733377 run osmo-msc_10.42.42.6(pid=18804): stdout: | (launched: 2022-12-13_12:10:50.525467) 12:10:51.785574 run osmo-msc_10.42.42.6(pid=18804): stderr: | 20221213121050845 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121050845 DLGLOBAL DEBUG validating counter group 0x7ff7ae70fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121050845 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121050845 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121050845 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121050845 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121050847 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121050847 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121050848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121050848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:10:51.842411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18797): Terminating (SIGTERM) 12:10:51.882755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18800): Terminating (SIGTERM) 12:10:51.927314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18803): Terminating (SIGTERM) 12:10:51.970317 --- ParallelTerminationStrategy: PID 18797 died... 12:10:51.990865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18797): Terminated: ok {rc=0} 12:10:52.037724 --- ParallelTerminationStrategy: PID 18800 died... 12:10:52.058049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18800): Terminated: ok {rc=0} 12:10:52.104536 --- ParallelTerminationStrategy: PID 18803 died... 12:10:52.125026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18803): Terminated: ok {rc=0} 12:10:52.213218 bus /sierra_3: Setting Powered False 12:10:53.310322 bus /sierra_3: Setting Powered False 12:10:54.424470 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:10:55.672462 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:55.680319 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:10:55.715258 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:10:55.743090 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:10:55.796808 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:10:55.830510 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:10:55.858354 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:10:56.410608 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:10:56.471788 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:10:56.482998 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:10:56.551740 tst mo_mt_call.py: using LAC 33853 12:10:56.672852 tst mo_mt_call.py: using RAC 193 12:10:56.791696 tst mo_mt_call.py: using CellId 33853 12:10:56.911512 tst mo_mt_call.py: using BVCI 33854 12:10:57.022632 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:10:57.033759 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:10:57.044619 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:10:57.055503 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:10:57.066528 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:10:57.077481 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:10:57.197538 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:10:57.312071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:57.780023 run create_hlr_db(pid=18810): Launched 12:10:57.903883 bus /sierra_2: Setting Powered False 12:10:58.964906 run create_hlr_db(pid=18810): Terminated: ok {rc=0} 12:10:59.386555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18812): Launched 12:10:59.688790 run osmo-hlr_10.42.42.2(pid=18813): Launched 12:10:59.803635 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:00.322542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18815): Launched 12:11:00.627392 run osmo-stp_10.42.42.5(pid=18816): Launched 12:11:00.742787 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:01.325749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18818): Launched 12:11:01.666478 run osmo-msc_10.42.42.6(pid=18819): Launched 12:11:01.910002 run osmo-stp_10.42.42.5(pid=18816): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18816)] 12:11:02.191622 run osmo-stp_10.42.42.5(pid=18816): stdout: | (launched: 2022-12-13_12:11:00.572171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:02.382654 run osmo-stp_10.42.42.5(pid=18816): stderr: | 20221213121100740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121100740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121100741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121100741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121100741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121100742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121100742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:02.508765 run osmo-stp_10.42.42.5(pid=18816): stdout: | (launched: 2022-12-13_12:11:00.572171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:02.629573 run osmo-stp_10.42.42.5(pid=18816): stderr: | 20221213121100740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121100740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121100741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121100741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121100741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121100742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121100742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:02.774318 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18816): Process ended prematurely: osmo-stp_10.42.42.5(pid=18816) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18816)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:11:02.783400 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:11:02.810173 run osmo-hlr_10.42.42.2(pid=18813): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18813)] 12:11:02.858407 run osmo-hlr_10.42.42.2(pid=18813): stdout: | (launched: 2022-12-13_12:10:59.633859) 12:11:02.908169 run osmo-hlr_10.42.42.2(pid=18813): stderr: | 20221213121059807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121059807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121059807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121059807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121059807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121059808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121059820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121059828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121059828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121059828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:02.977767 run osmo-msc_10.42.42.6(pid=18819): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18819)] 12:11:03.025935 run osmo-msc_10.42.42.6(pid=18819): stdout: | (launched: 2022-12-13_12:11:01.607062) 12:11:03.075971 run osmo-msc_10.42.42.6(pid=18819): stderr: | 20221213121102177 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121102177 DLGLOBAL DEBUG validating counter group 0x7f9fb68ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121102177 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121102178 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121102178 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121102178 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121102180 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121102180 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121102180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121102180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:03.126102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18812): Terminating (SIGTERM) 12:11:03.166081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18815): Terminating (SIGTERM) 12:11:03.206065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18818): Terminating (SIGTERM) 12:11:03.246060 --- ParallelTerminationStrategy: PID 18812 died... 12:11:03.265346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18812): Terminated: ok {rc=0} 12:11:03.309980 --- ParallelTerminationStrategy: PID 18815 died... 12:11:03.328933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18815): Terminated: ok {rc=0} 12:11:03.373441 --- ParallelTerminationStrategy: PID 18818 died... 12:11:03.392300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18818): Terminated: ok {rc=0} 12:11:03.480613 bus /sierra_3: Setting Powered False 12:11:04.581901 bus /sierra_3: Setting Powered False 12:11:05.699213 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:11:06.846624 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:11:06.858445 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:11:06.928508 tst mo_mt_call_osmux.py: using LAC 33854 12:11:07.051557 tst mo_mt_call_osmux.py: using RAC 194 12:11:07.170587 tst mo_mt_call_osmux.py: using CellId 33854 12:11:07.291158 tst mo_mt_call_osmux.py: using BVCI 33855 12:11:07.401211 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:11:07.412209 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:11:07.423085 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:11:07.433955 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:11:07.444881 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:11:07.455801 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:11:07.574868 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:11:07.693977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:08.165852 run create_hlr_db(pid=18821): Launched 12:11:08.289893 bus /sierra_2: Setting Powered False 12:11:09.351085 run create_hlr_db(pid=18821): Terminated: ok {rc=0} 12:11:09.772754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18823): Launched 12:11:10.076112 run osmo-hlr_10.42.42.2(pid=18824): Launched 12:11:10.192305 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:10.716667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18826): Launched 12:11:11.019432 run osmo-stp_10.42.42.5(pid=18827): Launched 12:11:11.134488 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:11.682712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18829): Launched 12:11:11.987258 run osmo-msc_10.42.42.6(pid=18830): Launched 12:11:12.156882 run osmo-stp_10.42.42.5(pid=18827): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18827)] 12:11:12.284396 run osmo-stp_10.42.42.5(pid=18827): stdout: | (launched: 2022-12-13_12:11:10.964421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:12.411673 run osmo-stp_10.42.42.5(pid=18827): stderr: | 20221213121111132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121111132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121111132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121111133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121111133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121111133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121111134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:12.537459 run osmo-stp_10.42.42.5(pid=18827): stdout: | (launched: 2022-12-13_12:11:10.964421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:12.657734 run osmo-stp_10.42.42.5(pid=18827): stderr: | 20221213121111132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121111132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121111132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121111133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121111133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121111133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121111134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:12.801452 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18827): Process ended prematurely: osmo-stp_10.42.42.5(pid=18827) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18827)] [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:11:12.810439 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:11:12.836882 run osmo-hlr_10.42.42.2(pid=18824): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18824)] 12:11:12.884211 run osmo-hlr_10.42.42.2(pid=18824): stdout: | (launched: 2022-12-13_12:11:10.020942) 12:11:12.933439 run osmo-hlr_10.42.42.2(pid=18824): stderr: | 20221213121110194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121110194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121110195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121110195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121110195 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121110195 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121110207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121110218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121110218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121110218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:13.001919 run osmo-msc_10.42.42.6(pid=18830): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18830)] 12:11:13.049414 run osmo-msc_10.42.42.6(pid=18830): stdout: | (launched: 2022-12-13_12:11:11.931938) 12:11:13.098541 run osmo-msc_10.42.42.6(pid=18830): stderr: | 20221213121112202 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121112202 DLGLOBAL DEBUG validating counter group 0x7fee3b115c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121112202 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121112203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121112203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121112203 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121112205 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121112205 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121112205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121112205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:13.147931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18823): Terminating (SIGTERM) 12:11:13.187371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18826): Terminating (SIGTERM) 12:11:13.226759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18829): Terminating (SIGTERM) 12:11:13.266608 --- ParallelTerminationStrategy: PID 18823 died... 12:11:13.285777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18823): Terminated: ok {rc=0} 12:11:13.329585 --- ParallelTerminationStrategy: PID 18826 died... 12:11:13.347952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18826): Terminated: ok {rc=0} 12:11:13.391620 --- ParallelTerminationStrategy: PID 18829 died... 12:11:13.410189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18829): Terminated: ok {rc=0} 12:11:13.493603 bus /sierra_3: Setting Powered False 12:11:14.590088 bus /sierra_3: Setting Powered False 12:11:15.708731 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:11:17.001832 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:17.008035 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:11:17.049389 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:11:17.084589 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:11:17.146151 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:11:17.181254 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:11:17.213709 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:11:17.761706 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:11:17.815151 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:17.826971 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:11:17.901906 tst mo_mt_call.py: using LAC 33855 12:11:18.019943 tst mo_mt_call.py: using RAC 195 12:11:18.138028 tst mo_mt_call.py: using CellId 33855 12:11:18.255522 tst mo_mt_call.py: using BVCI 33856 12:11:18.365087 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:18.376163 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:18.387241 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:18.398252 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:18.409392 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:18.420314 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:11:18.539537 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:11:18.656568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:19.126845 run create_hlr_db(pid=18835): Launched 12:11:19.250168 bus /sierra_2: Setting Powered False 12:11:20.311030 run create_hlr_db(pid=18835): Terminated: ok {rc=0} 12:11:20.733005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18837): Launched 12:11:21.037846 run osmo-hlr_10.42.42.2(pid=18838): Launched 12:11:21.154052 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:21.677283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18840): Launched 12:11:21.980401 run osmo-stp_10.42.42.5(pid=18841): Launched 12:11:22.095729 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:22.643046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18843): Launched 12:11:22.946495 run osmo-msc_10.42.42.6(pid=18844): Launched 12:11:23.115596 run osmo-stp_10.42.42.5(pid=18841): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18841)] 12:11:23.243736 run osmo-stp_10.42.42.5(pid=18841): stdout: | (launched: 2022-12-13_12:11:21.925342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:23.371505 run osmo-stp_10.42.42.5(pid=18841): stderr: | 20221213121122092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121122092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121122092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121122093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121122093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121122093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121122093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:23.497610 run osmo-stp_10.42.42.5(pid=18841): stdout: | (launched: 2022-12-13_12:11:21.925342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:23.618327 run osmo-stp_10.42.42.5(pid=18841): stderr: | 20221213121122092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121122092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121122092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121122093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121122093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121122093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121122093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:23.762990 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18841): Process ended prematurely: osmo-stp_10.42.42.5(pid=18841) [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18841)] [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:11:23.772003 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:11:23.798498 run osmo-hlr_10.42.42.2(pid=18838): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18838)] 12:11:23.845846 run osmo-hlr_10.42.42.2(pid=18838): stdout: | (launched: 2022-12-13_12:11:20.981488) 12:11:23.894620 run osmo-hlr_10.42.42.2(pid=18838): stderr: | 20221213121121156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121121156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121121156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121121156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121121156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121121156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121121168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121121177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121121177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121121177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:23.962782 run osmo-msc_10.42.42.6(pid=18844): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18844)] 12:11:24.009933 run osmo-msc_10.42.42.6(pid=18844): stdout: | (launched: 2022-12-13_12:11:22.891061) 12:11:24.058587 run osmo-msc_10.42.42.6(pid=18844): stderr: | 20221213121123161 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121123162 DLGLOBAL DEBUG validating counter group 0x7fabdd822c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121123162 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121123162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121123162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121123162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121123164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121123164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121123164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121123165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:24.107670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18837): Terminating (SIGTERM) 12:11:24.147130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18840): Terminating (SIGTERM) 12:11:24.186439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18843): Terminating (SIGTERM) 12:11:24.226622 --- ParallelTerminationStrategy: PID 18837 died... 12:11:24.245955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18837): Terminated: ok {rc=0} 12:11:24.289752 --- ParallelTerminationStrategy: PID 18840 died... 12:11:24.308304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18840): Terminated: ok {rc=0} 12:11:24.351639 --- ParallelTerminationStrategy: PID 18843 died... 12:11:24.370364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18843): Terminated: ok {rc=0} 12:11:24.455537 bus /sierra_3: Setting Powered False 12:11:25.553699 bus /sierra_3: Setting Powered False 12:11:26.666977 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:11:27.812481 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:27.824512 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:11:27.893887 tst mo_mt_call_osmux.py: using LAC 33856 12:11:28.013345 tst mo_mt_call_osmux.py: using RAC 196 12:11:28.132349 tst mo_mt_call_osmux.py: using CellId 33856 12:11:28.253298 tst mo_mt_call_osmux.py: using BVCI 33857 12:11:28.365628 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:28.377005 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:28.388104 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:28.399281 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:28.410537 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:11:28.421731 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:11:28.541602 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:11:28.659347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:29.163949 run create_hlr_db(pid=18846): Launched 12:11:29.289320 bus /sierra_2: Setting Powered False 12:11:30.353554 run create_hlr_db(pid=18846): Terminated: ok {rc=0} 12:11:30.807069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18848): Launched 12:11:31.177266 run osmo-hlr_10.42.42.2(pid=18849): Launched 12:11:31.394190 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:32.145006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18851): Launched 12:11:32.461031 run osmo-stp_10.42.42.5(pid=18852): Launched 12:11:32.581104 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:33.135982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18854): Launched 12:11:33.443629 run osmo-msc_10.42.42.6(pid=18855): Launched 12:11:33.616729 run osmo-stp_10.42.42.5(pid=18852): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18852)] 12:11:33.746482 run osmo-stp_10.42.42.5(pid=18852): stdout: | (launched: 2022-12-13_12:11:32.404570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:33.876211 run osmo-stp_10.42.42.5(pid=18852): stderr: | 20221213121132572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121132572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121132573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121132573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121132574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121132574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121132574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:34.003919 run osmo-stp_10.42.42.5(pid=18852): stdout: | (launched: 2022-12-13_12:11:32.404570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:34.125758 run osmo-stp_10.42.42.5(pid=18852): stderr: | 20221213121132572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121132572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121132573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121132573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121132574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121132574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121132574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:34.271606 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18852): Process ended prematurely: osmo-stp_10.42.42.5(pid=18852) [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18852)] [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:11:34.280846 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:11:34.308062 run osmo-hlr_10.42.42.2(pid=18849): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18849)] 12:11:34.356034 run osmo-hlr_10.42.42.2(pid=18849): stdout: | (launched: 2022-12-13_12:11:31.113641) 12:11:34.405456 run osmo-hlr_10.42.42.2(pid=18849): stderr: | 20221213121131509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121131509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121131509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121131509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121131510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121131510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121131522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121131534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121131535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121131535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:34.474632 run osmo-msc_10.42.42.6(pid=18855): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18855)] 12:11:34.522277 run osmo-msc_10.42.42.6(pid=18855): stdout: | (launched: 2022-12-13_12:11:33.387461) 12:11:34.571782 run osmo-msc_10.42.42.6(pid=18855): stderr: | 20221213121133657 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121133657 DLGLOBAL DEBUG validating counter group 0x7fa5bd88ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121133657 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121133657 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121133658 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121133658 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121133660 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121133660 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121133660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121133660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:34.621411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18848): Terminating (SIGTERM) 12:11:34.661285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18851): Terminating (SIGTERM) 12:11:34.700898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18854): Terminating (SIGTERM) 12:11:34.740574 --- ParallelTerminationStrategy: PID 18848 died... 12:11:34.760177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18848): Terminated: ok {rc=0} 12:11:34.804511 --- ParallelTerminationStrategy: PID 18851 died... 12:11:34.823283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18851): Terminated: ok {rc=0} 12:11:34.867355 --- ParallelTerminationStrategy: PID 18854 died... 12:11:34.886135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18854): Terminated: ok {rc=0} 12:11:34.972075 bus /sierra_3: Setting Powered False 12:11:36.072075 bus /sierra_3: Setting Powered False 12:11:37.185198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:11:38.443278 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:38.449486 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:11:38.482713 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:11:38.511170 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:11:38.563228 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:11:38.596624 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:11:38.624888 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:11:39.174018 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:11:39.223521 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:39.234682 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:11:39.302733 tst mo_mt_call.py: using LAC 33857 12:11:39.421462 tst mo_mt_call.py: using RAC 197 12:11:39.542559 tst mo_mt_call.py: using CellId 33857 12:11:39.663012 tst mo_mt_call.py: using BVCI 33858 12:11:39.783537 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:39.794960 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:39.806471 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:39.817830 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:39.829437 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:39.841136 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:11:39.959454 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:11:40.075606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:40.551374 run create_hlr_db(pid=18861): Launched 12:11:40.677391 bus /sierra_2: Setting Powered False 12:11:41.738995 run create_hlr_db(pid=18861): Terminated: ok {rc=0} 12:11:42.187529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18863): Launched 12:11:42.518853 run osmo-hlr_10.42.42.2(pid=18864): Launched 12:11:42.647747 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:43.215829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18866): Launched 12:11:43.544840 run osmo-stp_10.42.42.5(pid=18867): Launched 12:11:43.672239 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:44.264748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18869): Launched 12:11:44.594505 run osmo-msc_10.42.42.6(pid=18870): Launched 12:11:44.777890 run osmo-stp_10.42.42.5(pid=18867): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18867)] 12:11:44.916316 run osmo-stp_10.42.42.5(pid=18867): stdout: | (launched: 2022-12-13_12:11:43.485220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:45.055128 run osmo-stp_10.42.42.5(pid=18867): stderr: | 20221213121143675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121143675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121143675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121143676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121143676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121143676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121143676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:45.192371 run osmo-stp_10.42.42.5(pid=18867): stdout: | (launched: 2022-12-13_12:11:43.485220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:45.323392 run osmo-stp_10.42.42.5(pid=18867): stderr: | 20221213121143675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121143675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121143675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121143676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121143676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121143676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121143676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:45.480124 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18867): Process ended prematurely: osmo-stp_10.42.42.5(pid=18867) [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18867)] [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:11:45.489901 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:11:45.517775 run osmo-hlr_10.42.42.2(pid=18864): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18864)] 12:11:45.568710 run osmo-hlr_10.42.42.2(pid=18864): stdout: | (launched: 2022-12-13_12:11:42.459542) 12:11:45.621766 run osmo-hlr_10.42.42.2(pid=18864): stderr: | 20221213121142652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121142652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121142652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121142652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121142652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121142653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121142664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121142673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121142674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121142674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:45.694592 run osmo-msc_10.42.42.6(pid=18870): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18870)] 12:11:45.744712 run osmo-msc_10.42.42.6(pid=18870): stdout: | (launched: 2022-12-13_12:11:44.534672) 12:11:45.797474 run osmo-msc_10.42.42.6(pid=18870): stderr: | 20221213121144854 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121144854 DLGLOBAL DEBUG validating counter group 0x7fd211380c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121144854 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121144854 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121144854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121144854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121144856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121144856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121144857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121144857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:45.858770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18863): Terminating (SIGTERM) 12:11:45.904647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18866): Terminating (SIGTERM) 12:11:45.959646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18869): Terminating (SIGTERM) 12:11:46.002968 --- ParallelTerminationStrategy: PID 18863 died... 12:11:46.023649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18863): Terminated: ok {rc=0} 12:11:46.072460 --- ParallelTerminationStrategy: PID 18866 died... 12:11:46.094853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18866): Terminated: ok {rc=0} 12:11:46.143549 --- ParallelTerminationStrategy: PID 18869 died... 12:11:46.164823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18869): Terminated: ok {rc=0} 12:11:46.254251 bus /sierra_3: Setting Powered False 12:11:47.354095 bus /sierra_3: Setting Powered False 12:11:48.467675 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:11:49.619120 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:49.631381 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:11:49.704007 tst mo_mt_call_osmux.py: using LAC 33858 12:11:49.835704 tst mo_mt_call_osmux.py: using RAC 198 12:11:49.966268 tst mo_mt_call_osmux.py: using CellId 33858 12:11:50.094124 tst mo_mt_call_osmux.py: using BVCI 33859 12:11:50.215659 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:50.227250 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:50.238580 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:50.249996 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:50.261731 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:11:50.273474 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:11:50.390881 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:11:50.510891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:51.022287 run create_hlr_db(pid=18872): Launched 12:11:51.150016 bus /sierra_2: Setting Powered False 12:11:52.215084 run create_hlr_db(pid=18872): Terminated: ok {rc=0} 12:11:52.657236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18874): Launched 12:11:52.965163 run osmo-hlr_10.42.42.2(pid=18875): Launched 12:11:53.082417 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:53.613689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18877): Launched 12:11:53.921480 run osmo-stp_10.42.42.5(pid=18878): Launched 12:11:54.039038 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:54.603853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18880): Launched 12:11:54.911499 run osmo-msc_10.42.42.6(pid=18881): Launched 12:11:55.083192 run osmo-stp_10.42.42.5(pid=18878): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18878)] 12:11:55.212564 run osmo-stp_10.42.42.5(pid=18878): stdout: | (launched: 2022-12-13_12:11:53.865381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:55.341899 run osmo-stp_10.42.42.5(pid=18878): stderr: | 20221213121154032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121154032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121154033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121154033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121154034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121154034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121154034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:55.469605 run osmo-stp_10.42.42.5(pid=18878): stdout: | (launched: 2022-12-13_12:11:53.865381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:55.591802 run osmo-stp_10.42.42.5(pid=18878): stderr: | 20221213121154032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121154032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121154033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121154033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121154034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121154034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121154034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:55.738533 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18878): Process ended prematurely: osmo-stp_10.42.42.5(pid=18878) [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18878)] [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:11:55.747628 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:11:55.774464 run osmo-hlr_10.42.42.2(pid=18875): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18875)] 12:11:55.822776 run osmo-hlr_10.42.42.2(pid=18875): stdout: | (launched: 2022-12-13_12:11:52.908858) 12:11:55.872475 run osmo-hlr_10.42.42.2(pid=18875): stderr: | 20221213121153080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121153080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121153080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121153080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121153080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121153081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121153093 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121153103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121153103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121153103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:55.941964 run osmo-msc_10.42.42.6(pid=18881): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18881)] 12:11:55.990030 run osmo-msc_10.42.42.6(pid=18881): stdout: | (launched: 2022-12-13_12:11:54.855535) 12:11:56.039897 run osmo-msc_10.42.42.6(pid=18881): stderr: | 20221213121155122 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121155123 DLGLOBAL DEBUG validating counter group 0x7fdc8097dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121155123 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121155123 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121155123 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121155123 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121155125 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121155125 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121155125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121155125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:56.090080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18874): Terminating (SIGTERM) 12:11:56.129942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18877): Terminating (SIGTERM) 12:11:56.169782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18880): Terminating (SIGTERM) 12:11:56.209981 --- ParallelTerminationStrategy: PID 18874 died... 12:11:56.229510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18874): Terminated: ok {rc=0} 12:11:56.273828 --- ParallelTerminationStrategy: PID 18877 died... 12:11:56.292804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18877): Terminated: ok {rc=0} 12:11:56.337198 --- ParallelTerminationStrategy: PID 18880 died... 12:11:56.355941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18880): Terminated: ok {rc=0} 12:11:56.442691 bus /sierra_3: Setting Powered False 12:11:57.543459 bus /sierra_3: Setting Powered False 12:11:58.659909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:11:59.909021 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:59.915026 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:11:59.947418 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 12:11:59.974226 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 12:12:00.026011 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:12:00.058911 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 12:12:00.085415 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 12:12:00.642031 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 12:12:00.696146 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:00.708269 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:12:00.762210 tst mo_mt_call.py: using LAC 33859 12:12:00.904178 tst mo_mt_call.py: using RAC 199 12:12:01.038270 tst mo_mt_call.py: using CellId 33859 12:12:01.163050 tst mo_mt_call.py: using BVCI 33860 12:12:01.286502 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:01.299516 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:01.312567 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:01.325608 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:01.339648 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:01.354612 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:12:01.480382 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:12:01.597150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:02.085898 run create_hlr_db(pid=18886): Launched 12:12:02.246146 bus /sierra_2: Setting Powered False 12:12:03.308849 run create_hlr_db(pid=18886): Terminated: ok {rc=0} 12:12:03.758864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18888): Launched 12:12:04.089472 run osmo-hlr_10.42.42.2(pid=18889): Launched 12:12:04.216839 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:04.785469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18891): Launched 12:12:05.116708 run osmo-stp_10.42.42.5(pid=18892): Launched 12:12:05.244166 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:05.839917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18894): Launched 12:12:06.169666 run osmo-msc_10.42.42.6(pid=18895): Launched 12:12:06.354919 run osmo-stp_10.42.42.5(pid=18892): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18892)] 12:12:06.493839 run osmo-stp_10.42.42.5(pid=18892): stdout: | (launched: 2022-12-13_12:12:05.056534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:06.633715 run osmo-stp_10.42.42.5(pid=18892): stderr: | 20221213121205246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121205246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121205246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121205247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121205247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121205247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121205247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:06.771623 run osmo-stp_10.42.42.5(pid=18892): stdout: | (launched: 2022-12-13_12:12:05.056534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:06.903169 run osmo-stp_10.42.42.5(pid=18892): stderr: | 20221213121205246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121205246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121205246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121205247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121205247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121205247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121205247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:07.060869 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18892): Process ended prematurely: osmo-stp_10.42.42.5(pid=18892) [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18892)] [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 12:12:07.070996 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:12:07.099558 run osmo-hlr_10.42.42.2(pid=18889): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18889)] 12:12:07.151271 run osmo-hlr_10.42.42.2(pid=18889): stdout: | (launched: 2022-12-13_12:12:04.029988) 12:12:07.204371 run osmo-hlr_10.42.42.2(pid=18889): stderr: | 20221213121204224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121204224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121204224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121204224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121204224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121204224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121204237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121204246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121204246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121204246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:07.277609 run osmo-msc_10.42.42.6(pid=18895): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18895)] 12:12:07.327893 run osmo-msc_10.42.42.6(pid=18895): stdout: | (launched: 2022-12-13_12:12:06.110033) 12:12:07.380586 run osmo-msc_10.42.42.6(pid=18895): stderr: | 20221213121206428 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121206428 DLGLOBAL DEBUG validating counter group 0x7faf428c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121206428 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121206428 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121206428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121206428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121206430 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121206430 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121206431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121206431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:07.433417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18888): Terminating (SIGTERM) 12:12:07.475382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18891): Terminating (SIGTERM) 12:12:07.518257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18894): Terminating (SIGTERM) 12:12:07.561277 --- ParallelTerminationStrategy: PID 18888 died... 12:12:07.582133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18888): Terminated: ok {rc=0} 12:12:07.629812 --- ParallelTerminationStrategy: PID 18891 died... 12:12:07.650168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18891): Terminated: ok {rc=0} 12:12:07.697184 --- ParallelTerminationStrategy: PID 18894 died... 12:12:07.717450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18894): Terminated: ok {rc=0} 12:12:07.807162 bus /sierra_3: Setting Powered False 12:12:08.906453 bus /sierra_3: Setting Powered False 12:12:10.023923 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 12:12:11.174898 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:11.187671 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:12:11.242647 tst mo_mt_call_osmux.py: using LAC 33860 12:12:11.374040 tst mo_mt_call_osmux.py: using RAC 200 12:12:11.504586 tst mo_mt_call_osmux.py: using CellId 33860 12:12:11.635664 tst mo_mt_call_osmux.py: using BVCI 33861 12:12:11.757734 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:11.769791 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:11.781686 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:11.793569 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:11.806081 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:12:11.818304 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:12:11.939893 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:12:12.058975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:12.535075 run create_hlr_db(pid=18897): Launched 12:12:12.662391 bus /sierra_2: Setting Powered False 12:12:13.724681 run create_hlr_db(pid=18897): Terminated: ok {rc=0} 12:12:14.154712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18899): Launched 12:12:14.462993 run osmo-hlr_10.42.42.2(pid=18900): Launched 12:12:14.580391 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:15.109028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18902): Launched 12:12:15.417354 run osmo-stp_10.42.42.5(pid=18903): Launched 12:12:15.534988 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:16.127956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18905): Launched 12:12:16.526877 run osmo-msc_10.42.42.6(pid=18906): Launched 12:12:16.830457 run osmo-stp_10.42.42.5(pid=18903): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18903)] 12:12:17.197940 run osmo-stp_10.42.42.5(pid=18903): stdout: | (launched: 2022-12-13_12:12:15.360406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:17.404221 run osmo-stp_10.42.42.5(pid=18903): stderr: | 20221213121215530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121215530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121215531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121215531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121215531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121215532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121215532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:17.540129 run osmo-stp_10.42.42.5(pid=18903): stdout: | (launched: 2022-12-13_12:12:15.360406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:17.672662 run osmo-stp_10.42.42.5(pid=18903): stderr: | 20221213121215530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121215530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121215531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121215531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121215531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121215532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121215532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:17.831070 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18903): Process ended prematurely: osmo-stp_10.42.42.5(pid=18903) [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18903)] [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 12:12:17.842607 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 12:12:17.870557 run osmo-hlr_10.42.42.2(pid=18900): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18900)] 12:12:17.923028 run osmo-hlr_10.42.42.2(pid=18900): stdout: | (launched: 2022-12-13_12:12:14.406706) 12:12:17.975797 run osmo-hlr_10.42.42.2(pid=18900): stderr: | 20221213121214581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121214581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121214581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121214581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121214581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121214581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121214594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121214602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121214602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121214602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:18.049496 run osmo-msc_10.42.42.6(pid=18906): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18906)] 12:12:18.099476 run osmo-msc_10.42.42.6(pid=18906): stdout: | (launched: 2022-12-13_12:12:16.464432) 12:12:18.151902 run osmo-msc_10.42.42.6(pid=18906): stderr: | 20221213121217039 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121217039 DLGLOBAL DEBUG validating counter group 0x7f3df6b6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121217040 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121217040 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121217041 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121217042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121217050 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121217052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121217052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121217052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:18.205229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18899): Terminating (SIGTERM) 12:12:18.247308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18902): Terminating (SIGTERM) 12:12:18.289897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18905): Terminating (SIGTERM) 12:12:18.332731 --- ParallelTerminationStrategy: PID 18899 died... 12:12:18.353504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18899): Terminated: ok {rc=0} 12:12:18.400576 --- ParallelTerminationStrategy: PID 18902 died... 12:12:18.421067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18902): Terminated: ok {rc=0} 12:12:18.467746 --- ParallelTerminationStrategy: PID 18905 died... 12:12:18.488305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18905): Terminated: ok {rc=0} 12:12:18.578403 bus /sierra_3: Setting Powered False 12:12:19.677451 bus /sierra_3: Setting Powered False 12:12:20.793665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 emergency:trx-umtrx --------------------------------------------------------------------- 12:12:22.046828 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:12:22.051145 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:12:22.083682 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:12:22.110514 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 12:12:22.197134 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:12:22.230613 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:12:22.257406 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 12:12:22.839018 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2389 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 12:12:22.843957 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:22.854749 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 12:12:22.903683 tst emergency_mo_mt_call.py: using LAC 33861 12:12:23.021425 tst emergency_mo_mt_call.py: using RAC 201 12:12:23.140873 tst emergency_mo_mt_call.py: using CellId 33861 12:12:23.259819 tst emergency_mo_mt_call.py: using BVCI 33862 12:12:23.370176 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:23.380894 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:23.391552 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:23.402145 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:23.412612 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:23.423182 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:12:23.542726 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:12:23.661370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:24.130571 run create_hlr_db(pid=18912): Launched 12:12:24.255974 bus /sierra_2: Setting Powered False 12:12:25.316565 run create_hlr_db(pid=18912): Terminated: ok {rc=0} 12:12:25.761583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18914): Launched 12:12:26.088643 run osmo-hlr_10.42.42.2(pid=18915): Launched 12:12:26.212087 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:26.771424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18917): Launched 12:12:27.096017 run osmo-stp_10.42.42.5(pid=18918): Launched 12:12:27.228883 tst emergency_mo_mt_call.py: using MSISDN 8148 12:12:27.394500 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:27.977946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18920): Launched 12:12:28.303763 run osmo-msc_10.42.42.6(pid=18921): Launched 12:12:28.484478 run osmo-stp_10.42.42.5(pid=18918): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18918)] 12:12:28.620665 run osmo-stp_10.42.42.5(pid=18918): stdout: | (launched: 2022-12-13_12:12:27.036775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:28.758054 run osmo-stp_10.42.42.5(pid=18918): stderr: | 20221213121227227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121227227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121227227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121227228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121227228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121227229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121227229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:28.893743 run osmo-stp_10.42.42.5(pid=18918): stdout: | (launched: 2022-12-13_12:12:27.036775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:29.023326 run osmo-stp_10.42.42.5(pid=18918): stderr: | 20221213121227227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121227227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121227227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121227228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121227228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121227229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121227229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:29.178246 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18918): Process ended prematurely: osmo-stp_10.42.42.5(pid=18918) [trial-2389↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18918)] [trial-2389↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 12:12:29.187449 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 12:12:29.215099 run osmo-hlr_10.42.42.2(pid=18915): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18915)] 12:12:29.265863 run osmo-hlr_10.42.42.2(pid=18915): stdout: | (launched: 2022-12-13_12:12:26.029506) 12:12:29.318764 run osmo-hlr_10.42.42.2(pid=18915): stderr: | 20221213121226223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121226223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121226223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121226223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121226223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121226223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121226235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121226244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121226244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121226244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:29.392127 run osmo-msc_10.42.42.6(pid=18921): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18921)] 12:12:29.442242 run osmo-msc_10.42.42.6(pid=18921): stdout: | (launched: 2022-12-13_12:12:28.244345) 12:12:29.494271 run osmo-msc_10.42.42.6(pid=18921): stderr: | 20221213121228562 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121228562 DLGLOBAL DEBUG validating counter group 0x7f18b4f81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121228562 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121228562 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121228563 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121228563 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121228564 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121228565 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121228565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121228565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:29.546634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18914): Terminating (SIGTERM) 12:12:29.588866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18917): Terminating (SIGTERM) 12:12:29.631031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18920): Terminating (SIGTERM) 12:12:29.673924 --- ParallelTerminationStrategy: PID 18914 died... 12:12:29.694542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18914): Terminated: ok {rc=0} 12:12:29.741310 --- ParallelTerminationStrategy: PID 18917 died... 12:12:29.761373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18917): Terminated: ok {rc=0} 12:12:29.807918 --- ParallelTerminationStrategy: PID 18920 died... 12:12:29.827837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18920): Terminated: ok {rc=0} 12:12:29.916068 bus /sierra_3: Setting Powered False 12:12:31.020138 bus /sierra_3: Setting Powered False 12:12:32.148870 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 12:12:33.242992 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:33.254554 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 12:12:33.305199 tst emergency_preemptive_call.py: using LAC 33862 12:12:33.423553 tst emergency_preemptive_call.py: using RAC 202 12:12:33.544475 tst emergency_preemptive_call.py: using CellId 33862 12:12:33.663609 tst emergency_preemptive_call.py: using BVCI 33863 12:12:33.774772 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:33.785628 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:33.796232 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:33.806873 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:33.817646 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:12:33.828149 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:12:33.948755 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:12:34.065518 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:12:34.184343 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:12:34.300282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:34.770456 run create_hlr_db(pid=18923): Launched 12:12:34.896873 bus /sierra_2: Setting Powered False 12:12:35.958010 run create_hlr_db(pid=18923): Terminated: ok {rc=0} 12:12:36.401214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18925): Launched 12:12:36.725961 run osmo-hlr_10.42.42.2(pid=18926): Launched 12:12:36.849435 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:37.410534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18928): Launched 12:12:37.737882 run osmo-stp_10.42.42.5(pid=18929): Launched 12:12:37.872813 tst emergency_preemptive_call.py: using MSISDN 8149 12:12:38.041812 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:38.624385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18931): Launched 12:12:38.949663 run osmo-msc_10.42.42.6(pid=18932): Launched 12:12:39.130621 run osmo-stp_10.42.42.5(pid=18929): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18929)] 12:12:39.267690 run osmo-stp_10.42.42.5(pid=18929): stdout: | (launched: 2022-12-13_12:12:37.678496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:39.405968 run osmo-stp_10.42.42.5(pid=18929): stderr: | 20221213121237867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121237867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121237867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121237868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121237868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121237868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121237868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:39.541630 run osmo-stp_10.42.42.5(pid=18929): stdout: | (launched: 2022-12-13_12:12:37.678496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:39.671420 run osmo-stp_10.42.42.5(pid=18929): stderr: | 20221213121237867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121237867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121237867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121237868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121237868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121237868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121237868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:39.826434 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18929): Process ended prematurely: osmo-stp_10.42.42.5(pid=18929) [trial-2389↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18929)] [trial-2389↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 12:12:39.835621 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 12:12:39.863163 run osmo-hlr_10.42.42.2(pid=18926): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18926)] 12:12:39.913794 run osmo-hlr_10.42.42.2(pid=18926): stdout: | (launched: 2022-12-13_12:12:36.666979) 12:12:39.965882 run osmo-hlr_10.42.42.2(pid=18926): stderr: | 20221213121236861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121236861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121236861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121236861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121236862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121236862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121236874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121236884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121236884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121236884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:40.038737 run osmo-msc_10.42.42.6(pid=18932): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18932)] 12:12:40.088482 run osmo-msc_10.42.42.6(pid=18932): stdout: | (launched: 2022-12-13_12:12:38.890643) 12:12:40.140261 run osmo-msc_10.42.42.6(pid=18932): stderr: | 20221213121239209 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121239209 DLGLOBAL DEBUG validating counter group 0x7f8d68184c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121239210 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121239210 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121239210 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121239210 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121239212 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121239212 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121239212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121239212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:40.192276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18925): Terminating (SIGTERM) 12:12:40.234549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18928): Terminating (SIGTERM) 12:12:40.277123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18931): Terminating (SIGTERM) 12:12:40.319471 --- ParallelTerminationStrategy: PID 18925 died... 12:12:40.340012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18925): Terminated: ok {rc=0} 12:12:40.386550 --- ParallelTerminationStrategy: PID 18928 died... 12:12:40.406889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18928): Terminated: ok {rc=0} 12:12:40.453197 --- ParallelTerminationStrategy: PID 18931 died... 12:12:40.472921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18931): Terminated: ok {rc=0} 12:12:40.560317 bus /sierra_9: Setting Powered False 12:12:41.659447 bus /sierra_9: Setting Powered False 12:12:42.775983 bus /sierra_8: Setting Powered False 12:12:43.874001 bus /sierra_8: Setting Powered False 12:12:44.988798 bus /sierra_3: Setting Powered False 12:12:46.087438 bus /sierra_3: Setting Powered False 12:12:47.207870 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx --------------------------------------------------------------------- 12:12:48.488491 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:12:48.492717 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:12:48.525034 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 12:12:48.563773 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 12:12:48.650506 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:12:48.682810 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 12:12:48.721680 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 12:12:49.310857 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 12:12:49.360841 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:12:49.371495 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:12:49.419752 tst cs_paging_gprs_active.py: using LAC 33863 12:12:49.544607 tst cs_paging_gprs_active.py: using RAC 203 12:12:49.665428 tst cs_paging_gprs_active.py: using CellId 33863 12:12:49.786542 tst cs_paging_gprs_active.py: using BVCI 33864 12:12:49.899578 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:12:49.910334 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:12:49.920761 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:12:49.931267 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:12:49.941618 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:12:49.952325 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:12:49.963365 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:12:49.973672 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:12:49.984142 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:12:50.105625 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:12:50.221464 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:12:50.445810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:12:50.777486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18938): Launched 12:12:51.067102 run iperf3-srv_10.42.42.10(pid=18939): Launched 12:12:51.191574 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:12:51.415172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:12:51.747583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18940): Launched 12:12:52.035158 run iperf3-srv_10.42.42.10(pid=18941): Launched 12:12:52.159434 tst cs_paging_gprs_active.py:38: start network... 12:12:52.382477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:52.894626 run create_hlr_db(pid=18942): Launched 12:12:53.023937 bus /sierra_2: Setting Powered False 12:12:54.088826 run create_hlr_db(pid=18942): Terminated: ok {rc=0} 12:12:54.529700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18944): Launched 12:12:54.840830 run osmo-hlr_10.42.42.2(pid=18945): Launched 12:12:54.959081 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:55.504233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18947): Launched 12:12:55.812935 run osmo-stp_10.42.42.5(pid=18948): Launched 12:12:55.930084 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:12:56.460339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18950): Launched 12:12:56.578848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:12:56.838170 run patchelf(pid=18951): Launched 12:12:57.010619 run osmo-stp_10.42.42.5(pid=18948): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18948)] 12:12:57.140660 run osmo-stp_10.42.42.5(pid=18948): stdout: | (launched: 2022-12-13_12:12:55.756446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:57.272655 run osmo-stp_10.42.42.5(pid=18948): stderr: | 20221213121255926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121255926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121255926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121255927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121255927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121255927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121255927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:57.405227 run osmo-stp_10.42.42.5(pid=18948): stdout: | (launched: 2022-12-13_12:12:55.756446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:57.530746 run osmo-stp_10.42.42.5(pid=18948): stderr: | 20221213121255926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121255926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121255926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121255927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121255927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121255927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121255927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:57.679904 run patchelf(pid=18951): Terminating (SIGINT) 12:12:57.852223 run patchelf(pid=18951): Terminated: ok {rc=0} 12:12:57.976229 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18948): Process ended prematurely: osmo-stp_10.42.42.5(pid=18948) [trial-2389↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18948)] [trial-2389↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 12:12:57.985947 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:12:58.013348 run osmo-hlr_10.42.42.2(pid=18945): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18945)] 12:12:58.060833 run osmo-hlr_10.42.42.2(pid=18945): stdout: | (launched: 2022-12-13_12:12:54.783995) 12:12:58.110141 run osmo-hlr_10.42.42.2(pid=18945): stderr: | 20221213121254958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121254958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121254958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121254958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121254958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121254958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121254970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121254979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121254979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121254979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:58.159686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18938): Terminating (SIGTERM) 12:12:58.199606 run iperf3-srv_10.42.42.10(pid=18939): Terminating (SIGTERM) 12:12:58.239170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18940): Terminating (SIGTERM) 12:12:58.279135 run iperf3-srv_10.42.42.10(pid=18941): Terminating (SIGTERM) 12:12:58.318760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18944): Terminating (SIGTERM) 12:12:58.358485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18947): Terminating (SIGTERM) 12:12:58.398250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18950): Terminating (SIGTERM) 12:12:58.438516 --- ParallelTerminationStrategy: PID 18938 died... 12:12:58.458004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18938): Terminated: ok {rc=0} 12:12:58.502110 --- ParallelTerminationStrategy: PID 18939 died... 12:12:58.520646 run iperf3-srv_10.42.42.10(pid=18939): Terminated {rc=256} 12:12:58.564394 --- ParallelTerminationStrategy: PID 18940 died... 12:12:58.583143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18940): Terminated: ok {rc=0} 12:12:58.627439 --- ParallelTerminationStrategy: PID 18941 died... 12:12:58.646314 run iperf3-srv_10.42.42.10(pid=18941): Terminated {rc=256} 12:12:58.690171 --- ParallelTerminationStrategy: PID 18944 died... 12:12:58.708978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18944): Terminated: ok {rc=0} 12:12:58.752764 --- ParallelTerminationStrategy: PID 18947 died... 12:12:58.771754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18947): Terminated: ok {rc=0} 12:12:58.816223 --- ParallelTerminationStrategy: PID 18950 died... 12:12:58.835251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18950): Terminated: ok {rc=0} 12:12:58.922594 bus /gobi_0: Setting Powered False 12:13:00.023023 bus /gobi_0: Setting Powered False 12:13:01.137569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx iperf3.py ---------------------------------------------- 12:13:02.284044 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:02.295416 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:13:02.346251 tst iperf3.py: using LAC 33864 12:13:02.469247 tst iperf3.py: using RAC 204 12:13:02.592182 tst iperf3.py: using CellId 33864 12:13:02.715542 tst iperf3.py: using BVCI 33865 12:13:02.830032 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:02.840624 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:02.851321 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:02.862071 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:02.872342 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:02.882738 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:02.893835 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:02.904298 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:02.915054 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:13:03.034383 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:13:03.260093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:03.592746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18952): Launched 12:13:03.881723 run iperf3-srv_10.42.42.10(pid=18953): Launched 12:13:04.007071 tst iperf3.py:8: start network... 12:13:04.232554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:04.746212 run create_hlr_db(pid=18954): Launched 12:13:04.874607 bus /gobi_6: Setting Powered False 12:13:05.936172 run create_hlr_db(pid=18954): Terminated: ok {rc=0} 12:13:06.375296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18956): Launched 12:13:06.684787 run osmo-hlr_10.42.42.2(pid=18957): Launched 12:13:06.802678 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:07.334857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18959): Launched 12:13:07.642170 run osmo-stp_10.42.42.5(pid=18960): Launched 12:13:07.759265 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:08.288582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18962): Launched 12:13:08.407316 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:08.668786 run patchelf(pid=18963): Launched 12:13:08.840295 run osmo-stp_10.42.42.5(pid=18960): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18960)] 12:13:08.970747 run osmo-stp_10.42.42.5(pid=18960): stdout: | (launched: 2022-12-13_12:13:07.585976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:09.104096 run osmo-stp_10.42.42.5(pid=18960): stderr: | 20221213121307755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121307755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121307756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121307756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121307756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121307757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121307757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:09.236443 run osmo-stp_10.42.42.5(pid=18960): stdout: | (launched: 2022-12-13_12:13:07.585976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:09.362356 run osmo-stp_10.42.42.5(pid=18960): stderr: | 20221213121307755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121307755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121307756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121307756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121307756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121307757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121307757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:09.511472 run patchelf(pid=18963): Terminating (SIGINT) 12:13:09.683555 run patchelf(pid=18963): Terminated: ok {rc=0} 12:13:09.807937 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18960): Process ended prematurely: osmo-stp_10.42.42.5(pid=18960) [trial-2389↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18960)] [trial-2389↪gprs:trx-umtrx↪iperf3.py:8] 12:13:09.817756 tst iperf3.py:8: Test FAILED (7.6 sec) 12:13:09.845225 run osmo-hlr_10.42.42.2(pid=18957): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18957)] 12:13:09.892774 run osmo-hlr_10.42.42.2(pid=18957): stdout: | (launched: 2022-12-13_12:13:06.627964) 12:13:09.942067 run osmo-hlr_10.42.42.2(pid=18957): stderr: | 20221213121306802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121306802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121306802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121306802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121306802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121306802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121306814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121306824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121306825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121306825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:09.991723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18952): Terminating (SIGTERM) 12:13:10.031832 run iperf3-srv_10.42.42.10(pid=18953): Terminating (SIGTERM) 12:13:10.071715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18956): Terminating (SIGTERM) 12:13:10.111845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18959): Terminating (SIGTERM) 12:13:10.151716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18962): Terminating (SIGTERM) 12:13:10.192105 --- ParallelTerminationStrategy: PID 18952 died... 12:13:10.211513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18952): Terminated: ok {rc=0} 12:13:10.256176 --- ParallelTerminationStrategy: PID 18953 died... 12:13:10.275075 run iperf3-srv_10.42.42.10(pid=18953): Terminated {rc=256} 12:13:10.319814 --- ParallelTerminationStrategy: PID 18956 died... 12:13:10.338873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18956): Terminated: ok {rc=0} 12:13:10.382991 --- ParallelTerminationStrategy: PID 18959 died... 12:13:10.401931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18959): Terminated: ok {rc=0} 12:13:10.446023 --- ParallelTerminationStrategy: PID 18962 died... 12:13:10.464895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18962): Terminated: ok {rc=0} 12:13:10.548580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 12:13:11.700376 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:11.712262 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:13:11.762961 tst iperf3m4.py: using LAC 33865 12:13:11.892456 tst iperf3m4.py: using RAC 205 12:13:12.014634 tst iperf3m4.py: using CellId 33865 12:13:12.135646 tst iperf3m4.py: using BVCI 33866 12:13:12.248024 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:12.259033 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:12.269886 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:12.280533 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:12.291750 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:12.303019 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:12.314313 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:12.325313 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:12.336388 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:13:12.458722 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:13:12.583268 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:13:12.704477 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:13:12.823333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:13:13.033708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:13.346011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18964): Launched 12:13:13.619538 run iperf3-srv_10.42.42.10(pid=18965): Launched 12:13:13.736435 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:13:13.945138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:14.256093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18966): Launched 12:13:14.526362 run iperf3-srv_10.42.42.10(pid=18967): Launched 12:13:14.644259 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:13:14.852268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:15.163072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18968): Launched 12:13:15.433258 run iperf3-srv_10.42.42.10(pid=18969): Launched 12:13:15.549211 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:13:15.757371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:16.082128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18970): Launched 12:13:16.397839 run iperf3-srv_10.42.42.10(pid=18971): Launched 12:13:16.517302 tst iperf3m4.py:8: start network... 12:13:16.727936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:17.213746 run create_hlr_db(pid=18972): Launched 12:13:17.352415 bus /gobi_6: Setting Powered False 12:13:18.414203 run create_hlr_db(pid=18972): Terminated: ok {rc=0} 12:13:18.864879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18974): Launched 12:13:19.197513 run osmo-hlr_10.42.42.2(pid=18975): Launched 12:13:19.325760 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:19.902090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18977): Launched 12:13:20.234032 run osmo-stp_10.42.42.5(pid=18978): Launched 12:13:20.361324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:20.931978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18980): Launched 12:13:21.061357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:21.341856 run patchelf(pid=18981): Launched 12:13:21.528572 run osmo-stp_10.42.42.5(pid=18978): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18978)] 12:13:21.670070 run osmo-stp_10.42.42.5(pid=18978): stdout: | (launched: 2022-12-13_12:13:20.173823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:21.812452 run osmo-stp_10.42.42.5(pid=18978): stderr: | 20221213121320364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121320364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121320364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121320364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121320365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121320365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121320365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:21.955019 run osmo-stp_10.42.42.5(pid=18978): stdout: | (launched: 2022-12-13_12:13:20.173823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:22.091310 run osmo-stp_10.42.42.5(pid=18978): stderr: | 20221213121320364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121320364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121320364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121320364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121320365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121320365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121320365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:22.252463 run patchelf(pid=18981): Terminating (SIGINT) 12:13:22.438400 run patchelf(pid=18981): Terminated: ok {rc=0} 12:13:22.572915 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18978): Process ended prematurely: osmo-stp_10.42.42.5(pid=18978) [trial-2389↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18978)] [trial-2389↪gprs:trx-umtrx↪iperf3m4.py:8] 12:13:22.583422 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:13:22.612434 run osmo-hlr_10.42.42.2(pid=18975): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18975)] 12:13:22.663710 run osmo-hlr_10.42.42.2(pid=18975): stdout: | (launched: 2022-12-13_12:13:19.137261) 12:13:22.716857 run osmo-hlr_10.42.42.2(pid=18975): stderr: | 20221213121319335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121319335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121319335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121319335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121319335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121319335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121319347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121319357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121319357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121319357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:22.769999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18964): Terminating (SIGTERM) 12:13:22.812068 run iperf3-srv_10.42.42.10(pid=18965): Terminating (SIGTERM) 12:13:22.854930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18966): Terminating (SIGTERM) 12:13:22.897564 run iperf3-srv_10.42.42.10(pid=18967): Terminating (SIGTERM) 12:13:22.940732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18968): Terminating (SIGTERM) 12:13:22.983703 run iperf3-srv_10.42.42.10(pid=18969): Terminating (SIGTERM) 12:13:23.026322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18970): Terminating (SIGTERM) 12:13:23.069017 run iperf3-srv_10.42.42.10(pid=18971): Terminating (SIGTERM) 12:13:23.111490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18974): Terminating (SIGTERM) 12:13:23.154257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18977): Terminating (SIGTERM) 12:13:23.196854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18980): Terminating (SIGTERM) 12:13:23.239586 --- ParallelTerminationStrategy: PID 18964 died... 12:13:23.260415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18964): Terminated: ok {rc=0} 12:13:23.307584 --- ParallelTerminationStrategy: PID 18965 died... 12:13:23.327799 run iperf3-srv_10.42.42.10(pid=18965): Terminated {rc=256} 12:13:23.375261 --- ParallelTerminationStrategy: PID 18966 died... 12:13:23.395539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18966): Terminated: ok {rc=0} 12:13:23.442459 --- ParallelTerminationStrategy: PID 18967 died... 12:13:23.462734 run iperf3-srv_10.42.42.10(pid=18967): Terminated {rc=256} 12:13:23.509291 --- ParallelTerminationStrategy: PID 18968 died... 12:13:23.529208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18968): Terminated: ok {rc=0} 12:13:23.575739 --- ParallelTerminationStrategy: PID 18969 died... 12:13:23.595892 run iperf3-srv_10.42.42.10(pid=18969): Terminated {rc=256} 12:13:23.642215 --- ParallelTerminationStrategy: PID 18970 died... 12:13:23.662370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18970): Terminated: ok {rc=0} 12:13:23.709293 --- ParallelTerminationStrategy: PID 18971 died... 12:13:23.729443 run iperf3-srv_10.42.42.10(pid=18971): Terminated {rc=256} 12:13:23.776198 --- ParallelTerminationStrategy: PID 18974 died... 12:13:23.796377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18974): Terminated: ok {rc=0} 12:13:23.842889 --- ParallelTerminationStrategy: PID 18977 died... 12:13:23.863158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18977): Terminated: ok {rc=0} 12:13:23.909504 --- ParallelTerminationStrategy: PID 18980 died... 12:13:23.929604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18980): Terminated: ok {rc=0} 12:13:24.018403 bus /gobi_4: Setting Powered False 12:13:25.117697 bus /gobi_4: Setting Powered False 12:13:26.237405 bus /gobi_1: Setting Powered False 12:13:27.335457 bus /gobi_1: Setting Powered False 12:13:28.451213 bus /gobi_0: Setting Powered False 12:13:29.548865 bus /gobi_0: Setting Powered False 12:13:30.667022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx ping.py ---------------------------------------------- 12:13:31.772185 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:31.784474 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:13:31.835286 tst ping.py: using LAC 33866 12:13:31.969299 tst ping.py: using RAC 206 12:13:32.090230 tst ping.py: using CellId 33866 12:13:32.223156 tst ping.py: using BVCI 33867 12:13:32.342289 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:32.353681 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:32.364878 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:32.376196 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:32.387665 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:32.399122 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:32.410647 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:32.421972 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:13:32.538395 tst ping.py:19: start network... 12:13:32.742439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:33.210798 run create_hlr_db(pid=18982): Launched 12:13:33.334315 bus /gobi_6: Setting Powered False 12:13:34.395282 run create_hlr_db(pid=18982): Terminated: ok {rc=0} 12:13:34.839067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18984): Launched 12:13:35.163644 run osmo-hlr_10.42.42.2(pid=18985): Launched 12:13:35.287554 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:35.851791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18987): Launched 12:13:36.176424 run osmo-stp_10.42.42.5(pid=18988): Launched 12:13:36.300309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:36.860376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18990): Launched 12:13:36.985773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:37.260468 run patchelf(pid=18991): Launched 12:13:37.441467 run osmo-stp_10.42.42.5(pid=18988): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18988)] 12:13:37.578462 run osmo-stp_10.42.42.5(pid=18988): stdout: | (launched: 2022-12-13_12:13:36.117117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:37.717721 run osmo-stp_10.42.42.5(pid=18988): stderr: | 20221213121336308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121336308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121336309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121336309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121336310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121336310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121336310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:37.856672 run osmo-stp_10.42.42.5(pid=18988): stdout: | (launched: 2022-12-13_12:13:36.117117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:37.989267 run osmo-stp_10.42.42.5(pid=18988): stderr: | 20221213121336308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121336308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121336309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121336309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121336310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121336310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121336310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:38.146482 run patchelf(pid=18991): Terminating (SIGINT) 12:13:38.327685 run patchelf(pid=18991): Terminated: ok {rc=0} 12:13:38.458524 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18988): Process ended prematurely: osmo-stp_10.42.42.5(pid=18988) [trial-2389↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18988)] [trial-2389↪gprs:trx-umtrx↪ping.py:22] 12:13:38.468191 tst ping.py:22: Test FAILED (6.7 sec) 12:13:38.496603 run osmo-hlr_10.42.42.2(pid=18985): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18985)] 12:13:38.547536 run osmo-hlr_10.42.42.2(pid=18985): stdout: | (launched: 2022-12-13_12:13:35.104715) 12:13:38.599953 run osmo-hlr_10.42.42.2(pid=18985): stderr: | 20221213121335301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121335301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121335301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121335301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121335301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121335301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121335314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121335325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121335325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121335325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:38.652527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18984): Terminating (SIGTERM) 12:13:38.695034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18987): Terminating (SIGTERM) 12:13:38.737262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18990): Terminating (SIGTERM) 12:13:38.780070 --- ParallelTerminationStrategy: PID 18984 died... 12:13:38.800464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18984): Terminated: ok {rc=0} 12:13:38.846746 --- ParallelTerminationStrategy: PID 18987 died... 12:13:38.866695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18987): Terminated: ok {rc=0} 12:13:38.913096 --- ParallelTerminationStrategy: PID 18990 died... 12:13:38.932928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18990): Terminated: ok {rc=0} 12:13:39.020762 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 12:13:40.108761 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:40.120165 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:13:40.170121 tst ping_idle_ping.py: using LAC 33867 12:13:40.292160 tst ping_idle_ping.py: using RAC 207 12:13:40.411669 tst ping_idle_ping.py: using CellId 33867 12:13:40.545842 tst ping_idle_ping.py: using BVCI 33868 12:13:40.665971 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:40.677577 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:40.688612 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:40.699619 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:40.710878 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:40.722127 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:40.733693 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:13:40.744886 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:13:40.860724 tst ping_idle_ping.py:24: start network... 12:13:41.065422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:41.536925 run create_hlr_db(pid=18992): Launched 12:13:41.661823 bus /gobi_6: Setting Powered False 12:13:42.722864 run create_hlr_db(pid=18992): Terminated: ok {rc=0} 12:13:43.166894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18994): Launched 12:13:43.494159 run osmo-hlr_10.42.42.2(pid=18995): Launched 12:13:43.620498 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:44.182484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18997): Launched 12:13:44.509720 run osmo-stp_10.42.42.5(pid=18998): Launched 12:13:44.636159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:45.196591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19000): Launched 12:13:45.321917 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:45.596382 run patchelf(pid=19001): Launched 12:13:45.778716 run osmo-stp_10.42.42.5(pid=18998): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18998)] 12:13:45.935984 run osmo-stp_10.42.42.5(pid=18998): stdout: | (launched: 2022-12-13_12:13:44.450439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:46.069957 run osmo-stp_10.42.42.5(pid=18998): stderr: | 20221213121344638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121344638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121344639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121344639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121344640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121344640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121344640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:46.206376 run osmo-stp_10.42.42.5(pid=18998): stdout: | (launched: 2022-12-13_12:13:44.450439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:46.336751 run osmo-stp_10.42.42.5(pid=18998): stderr: | 20221213121344638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121344638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121344639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121344639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121344640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121344640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121344640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:46.489065 run patchelf(pid=19001): Terminating (SIGINT) 12:13:46.663694 run patchelf(pid=19001): Terminated: ok {rc=0} 12:13:46.790325 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18998): Process ended prematurely: osmo-stp_10.42.42.5(pid=18998) [trial-2389↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18998)] [trial-2389↪gprs:trx-umtrx↪ping_idle_ping.py:27] 12:13:46.799995 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:13:46.828685 run osmo-hlr_10.42.42.2(pid=18995): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18995)] 12:13:46.879309 run osmo-hlr_10.42.42.2(pid=18995): stdout: | (launched: 2022-12-13_12:13:43.435214) 12:13:46.931840 run osmo-hlr_10.42.42.2(pid=18995): stderr: | 20221213121343627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121343627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121343627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121343628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121343628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121343628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121343639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121343648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121343649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121343649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:46.983474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18994): Terminating (SIGTERM) 12:13:47.025192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18997): Terminating (SIGTERM) 12:13:47.069074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19000): Terminating (SIGTERM) 12:13:47.114760 --- ParallelTerminationStrategy: PID 18994 died... 12:13:47.135257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18994): Terminated: ok {rc=0} 12:13:47.182892 --- ParallelTerminationStrategy: PID 18997 died... 12:13:47.202570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18997): Terminated: ok {rc=0} 12:13:47.249148 --- ParallelTerminationStrategy: PID 19000 died... 12:13:47.268211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19000): Terminated: ok {rc=0} 12:13:47.354106 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 12:13:48.662245 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:13:48.668094 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:13:48.700603 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:13:48.739251 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:13:48.826685 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:13:48.859012 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:13:48.897800 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:13:49.490960 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:13:49.540782 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:49.551733 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:13:49.600915 tst cs_paging_gprs_active.py: using LAC 33868 12:13:49.721711 tst cs_paging_gprs_active.py: using RAC 208 12:13:49.843155 tst cs_paging_gprs_active.py: using CellId 33868 12:13:49.966182 tst cs_paging_gprs_active.py: using BVCI 33869 12:13:50.080892 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:50.091977 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:50.102715 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:50.113452 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:50.123916 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:50.134510 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:50.145796 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:50.156376 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:13:50.167213 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:13:50.287987 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:13:50.407690 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:13:50.615914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:50.927348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19006): Launched 12:13:51.198151 run iperf3-srv_10.42.42.10(pid=19007): Launched 12:13:51.314382 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:13:51.522293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:13:51.832728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19008): Launched 12:13:52.103526 run iperf3-srv_10.42.42.10(pid=19009): Launched 12:13:52.219963 tst cs_paging_gprs_active.py:38: start network... 12:13:52.427269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:52.906031 run create_hlr_db(pid=19010): Launched 12:13:53.034621 bus /gobi_6: Setting Powered False 12:13:54.096542 run create_hlr_db(pid=19010): Terminated: ok {rc=0} 12:13:54.549498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19012): Launched 12:13:54.885360 run osmo-hlr_10.42.42.2(pid=19013): Launched 12:13:55.014251 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:55.590081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19015): Launched 12:13:55.922443 run osmo-stp_10.42.42.5(pid=19016): Launched 12:13:56.050812 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:13:56.622335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19018): Launched 12:13:56.750181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:13:57.029877 run patchelf(pid=19019): Launched 12:13:57.214731 run osmo-stp_10.42.42.5(pid=19016): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19016)] 12:13:57.355805 run osmo-stp_10.42.42.5(pid=19016): stdout: | (launched: 2022-12-13_12:13:55.862087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:57.498450 run osmo-stp_10.42.42.5(pid=19016): stderr: | 20221213121356051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121356051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121356051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121356051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121356052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121356052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121356052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:57.640730 run osmo-stp_10.42.42.5(pid=19016): stdout: | (launched: 2022-12-13_12:13:55.862087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:57.777166 run osmo-stp_10.42.42.5(pid=19016): stderr: | 20221213121356051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121356051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121356051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121356051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121356052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121356052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121356052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:57.938247 run patchelf(pid=19019): Terminating (SIGINT) 12:13:58.124409 run patchelf(pid=19019): Terminated: ok {rc=0} 12:13:58.258165 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19016): Process ended prematurely: osmo-stp_10.42.42.5(pid=19016) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19016)] [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:13:58.268541 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:13:58.297611 run osmo-hlr_10.42.42.2(pid=19013): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19013)] 12:13:58.348426 run osmo-hlr_10.42.42.2(pid=19013): stdout: | (launched: 2022-12-13_12:13:54.824560) 12:13:58.400805 run osmo-hlr_10.42.42.2(pid=19013): stderr: | 20221213121355020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121355020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121355020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121355020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121355021 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121355021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121355033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121355042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121355042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121355042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:58.453296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19006): Terminating (SIGTERM) 12:13:58.495479 run iperf3-srv_10.42.42.10(pid=19007): Terminating (SIGTERM) 12:13:58.538304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19008): Terminating (SIGTERM) 12:13:58.580636 run iperf3-srv_10.42.42.10(pid=19009): Terminating (SIGTERM) 12:13:58.622745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19012): Terminating (SIGTERM) 12:13:58.665695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19015): Terminating (SIGTERM) 12:13:58.708106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19018): Terminating (SIGTERM) 12:13:58.750721 --- ParallelTerminationStrategy: PID 19006 died... 12:13:58.771279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19006): Terminated: ok {rc=0} 12:13:58.817984 --- ParallelTerminationStrategy: PID 19007 died... 12:13:58.837872 run iperf3-srv_10.42.42.10(pid=19007): Terminated {rc=256} 12:13:58.884347 --- ParallelTerminationStrategy: PID 19008 died... 12:13:58.904452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19008): Terminated: ok {rc=0} 12:13:58.950930 --- ParallelTerminationStrategy: PID 19009 died... 12:13:58.970835 run iperf3-srv_10.42.42.10(pid=19009): Terminated {rc=256} 12:13:59.017359 --- ParallelTerminationStrategy: PID 19012 died... 12:13:59.037418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19012): Terminated: ok {rc=0} 12:13:59.084096 --- ParallelTerminationStrategy: PID 19015 died... 12:13:59.104235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19015): Terminated: ok {rc=0} 12:13:59.150898 --- ParallelTerminationStrategy: PID 19018 died... 12:13:59.170901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19018): Terminated: ok {rc=0} 12:13:59.259771 bus /gobi_0: Setting Powered False 12:14:00.358598 bus /gobi_0: Setting Powered False 12:14:01.483798 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:14:02.636770 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:02.648760 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:14:02.703892 tst iperf3.py: using LAC 33869 12:14:02.825940 tst iperf3.py: using RAC 209 12:14:02.947012 tst iperf3.py: using CellId 33869 12:14:03.070551 tst iperf3.py: using BVCI 33870 12:14:03.184111 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:03.195295 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:03.206092 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:03.216857 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:03.227588 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:03.238243 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:03.249144 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:03.260104 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:03.271173 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:14:03.391575 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:14:03.617341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:03.950399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19020): Launched 12:14:04.238424 run iperf3-srv_10.42.42.10(pid=19021): Launched 12:14:04.364114 tst iperf3.py:8: start network... 12:14:04.589121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:05.100352 run create_hlr_db(pid=19022): Launched 12:14:05.226331 bus /gobi_6: Setting Powered False 12:14:06.288078 run create_hlr_db(pid=19022): Terminated: ok {rc=0} 12:14:06.746831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19024): Launched 12:14:07.078532 run osmo-hlr_10.42.42.2(pid=19025): Launched 12:14:07.206485 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:07.781005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19027): Launched 12:14:08.110934 run osmo-stp_10.42.42.5(pid=19028): Launched 12:14:08.238969 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:08.807463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19030): Launched 12:14:08.936488 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:09.215405 run patchelf(pid=19031): Launched 12:14:09.400301 run osmo-stp_10.42.42.5(pid=19028): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19028)] 12:14:09.540055 run osmo-stp_10.42.42.5(pid=19028): stdout: | (launched: 2022-12-13_12:14:08.051204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:09.680698 run osmo-stp_10.42.42.5(pid=19028): stderr: | 20221213121408239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121408239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121408240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121408240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121408240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121408241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121408241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:09.821975 run osmo-stp_10.42.42.5(pid=19028): stdout: | (launched: 2022-12-13_12:14:08.051204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:09.956556 run osmo-stp_10.42.42.5(pid=19028): stderr: | 20221213121408239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121408239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121408240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121408240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121408240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121408241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121408241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:10.116211 run patchelf(pid=19031): Terminating (SIGINT) 12:14:10.300353 run patchelf(pid=19031): Terminated: ok {rc=0} 12:14:10.433511 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19028): Process ended prematurely: osmo-stp_10.42.42.5(pid=19028) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19028)] [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 12:14:10.443971 tst iperf3.py:8: Test FAILED (7.8 sec) 12:14:10.472625 run osmo-hlr_10.42.42.2(pid=19025): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19025)] 12:14:10.523269 run osmo-hlr_10.42.42.2(pid=19025): stdout: | (launched: 2022-12-13_12:14:07.018705) 12:14:10.575626 run osmo-hlr_10.42.42.2(pid=19025): stderr: | 20221213121407214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121407214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121407214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121407214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121407214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121407214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121407227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121407237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121407238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121407238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:10.628436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19020): Terminating (SIGTERM) 12:14:10.670292 run iperf3-srv_10.42.42.10(pid=19021): Terminating (SIGTERM) 12:14:10.713183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19024): Terminating (SIGTERM) 12:14:10.755234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19027): Terminating (SIGTERM) 12:14:10.797676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19030): Terminating (SIGTERM) 12:14:10.839844 --- ParallelTerminationStrategy: PID 19020 died... 12:14:10.860252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19020): Terminated: ok {rc=0} 12:14:10.906822 --- ParallelTerminationStrategy: PID 19021 died... 12:14:10.926922 run iperf3-srv_10.42.42.10(pid=19021): Terminated {rc=256} 12:14:10.973346 --- ParallelTerminationStrategy: PID 19024 died... 12:14:10.993429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19024): Terminated: ok {rc=0} 12:14:11.039929 --- ParallelTerminationStrategy: PID 19027 died... 12:14:11.059923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19027): Terminated: ok {rc=0} 12:14:11.106520 --- ParallelTerminationStrategy: PID 19030 died... 12:14:11.126645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19030): Terminated: ok {rc=0} 12:14:11.215662 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:14:12.362755 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:12.374405 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:14:12.423427 tst iperf3m4.py: using LAC 33870 12:14:12.547625 tst iperf3m4.py: using RAC 210 12:14:12.679399 tst iperf3m4.py: using CellId 33870 12:14:12.819404 tst iperf3m4.py: using BVCI 33871 12:14:12.942264 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:12.953821 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:12.964895 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:12.976126 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:12.988037 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:12.999890 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:13.011995 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:13.023907 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:13.036103 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:14:13.156029 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:14:13.279372 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:14:13.397399 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:14:13.519055 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:14:13.745511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:14.078246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19032): Launched 12:14:14.367622 run iperf3-srv_10.42.42.10(pid=19033): Launched 12:14:14.492780 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:14:14.718503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:15.050824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19034): Launched 12:14:15.340361 run iperf3-srv_10.42.42.10(pid=19035): Launched 12:14:15.464488 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:14:15.689713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:16.042968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19036): Launched 12:14:16.411512 run iperf3-srv_10.42.42.10(pid=19037): Launched 12:14:16.561694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:14:16.775238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:17.094397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19038): Launched 12:14:17.380917 run iperf3-srv_10.42.42.10(pid=19039): Launched 12:14:17.496834 tst iperf3m4.py:8: start network... 12:14:17.705573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:18.184372 run create_hlr_db(pid=19040): Launched 12:14:18.310601 bus /gobi_6: Setting Powered False 12:14:19.372861 run create_hlr_db(pid=19040): Terminated: ok {rc=0} 12:14:19.803259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19042): Launched 12:14:20.111885 run osmo-hlr_10.42.42.2(pid=19043): Launched 12:14:20.229095 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:20.760226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19045): Launched 12:14:21.069664 run osmo-stp_10.42.42.5(pid=19046): Launched 12:14:21.188055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:21.724807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19048): Launched 12:14:21.843165 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:22.103496 run patchelf(pid=19049): Launched 12:14:22.275284 run osmo-stp_10.42.42.5(pid=19046): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19046)] 12:14:22.405931 run osmo-stp_10.42.42.5(pid=19046): stdout: | (launched: 2022-12-13_12:14:21.012763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:22.538080 run osmo-stp_10.42.42.5(pid=19046): stderr: | 20221213121421181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121421181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121421181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121421182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121421182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121421182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121421182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:22.669943 run osmo-stp_10.42.42.5(pid=19046): stdout: | (launched: 2022-12-13_12:14:21.012763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:22.795941 run osmo-stp_10.42.42.5(pid=19046): stderr: | 20221213121421181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121421181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121421181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121421182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121421182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121421182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121421182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:22.945128 run patchelf(pid=19049): Terminating (SIGINT) 12:14:23.117604 run patchelf(pid=19049): Terminated: ok {rc=0} 12:14:23.242252 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19046): Process ended prematurely: osmo-stp_10.42.42.5(pid=19046) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19046)] [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 12:14:23.251899 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:14:23.279580 run osmo-hlr_10.42.42.2(pid=19043): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19043)] 12:14:23.327385 run osmo-hlr_10.42.42.2(pid=19043): stdout: | (launched: 2022-12-13_12:14:20.055261) 12:14:23.376716 run osmo-hlr_10.42.42.2(pid=19043): stderr: | 20221213121420227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121420227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121420227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121420227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121420227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121420227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121420242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121420250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121420250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121420250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:23.426698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19032): Terminating (SIGTERM) 12:14:23.466556 run iperf3-srv_10.42.42.10(pid=19033): Terminating (SIGTERM) 12:14:23.506530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19034): Terminating (SIGTERM) 12:14:23.546620 run iperf3-srv_10.42.42.10(pid=19035): Terminating (SIGTERM) 12:14:23.586516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19036): Terminating (SIGTERM) 12:14:23.626887 run iperf3-srv_10.42.42.10(pid=19037): Terminating (SIGTERM) 12:14:23.666862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19038): Terminating (SIGTERM) 12:14:23.706727 run iperf3-srv_10.42.42.10(pid=19039): Terminating (SIGTERM) 12:14:23.746533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19042): Terminating (SIGTERM) 12:14:23.786541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19045): Terminating (SIGTERM) 12:14:23.826464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19048): Terminating (SIGTERM) 12:14:23.866533 --- ParallelTerminationStrategy: PID 19032 died... 12:14:23.885985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19032): Terminated: ok {rc=0} 12:14:23.930528 --- ParallelTerminationStrategy: PID 19033 died... 12:14:23.949457 run iperf3-srv_10.42.42.10(pid=19033): Terminated {rc=256} 12:14:23.993288 --- ParallelTerminationStrategy: PID 19034 died... 12:14:24.011767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19034): Terminated: ok {rc=0} 12:14:24.056184 --- ParallelTerminationStrategy: PID 19035 died... 12:14:24.074903 run iperf3-srv_10.42.42.10(pid=19035): Terminated {rc=256} 12:14:24.119193 --- ParallelTerminationStrategy: PID 19036 died... 12:14:24.138178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19036): Terminated: ok {rc=0} 12:14:24.182310 --- ParallelTerminationStrategy: PID 19037 died... 12:14:24.201214 run iperf3-srv_10.42.42.10(pid=19037): Terminated {rc=256} 12:14:24.245212 --- ParallelTerminationStrategy: PID 19038 died... 12:14:24.264056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19038): Terminated: ok {rc=0} 12:14:24.308436 --- ParallelTerminationStrategy: PID 19039 died... 12:14:24.327327 run iperf3-srv_10.42.42.10(pid=19039): Terminated {rc=256} 12:14:24.371560 --- ParallelTerminationStrategy: PID 19042 died... 12:14:24.390524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19042): Terminated: ok {rc=0} 12:14:24.434929 --- ParallelTerminationStrategy: PID 19045 died... 12:14:24.453858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19045): Terminated: ok {rc=0} 12:14:24.498163 --- ParallelTerminationStrategy: PID 19048 died... 12:14:24.517150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19048): Terminated: ok {rc=0} 12:14:24.603632 bus /gobi_4: Setting Powered False 12:14:25.704315 bus /gobi_4: Setting Powered False 12:14:26.819809 bus /gobi_1: Setting Powered False 12:14:27.919294 bus /gobi_1: Setting Powered False 12:14:29.035821 bus /gobi_0: Setting Powered False 12:14:30.134252 bus /gobi_0: Setting Powered False 12:14:31.252321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 12:14:32.354806 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:32.366433 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:14:32.416634 tst ping.py: using LAC 33871 12:14:32.536613 tst ping.py: using RAC 211 12:14:32.655660 tst ping.py: using CellId 33871 12:14:32.776188 tst ping.py: using BVCI 33872 12:14:32.887320 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:32.898344 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:32.909090 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:32.919794 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:32.930446 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:32.941050 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:32.951870 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:32.962579 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:14:33.081470 tst ping.py:19: start network... 12:14:33.300892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:33.803714 run create_hlr_db(pid=19051): Launched 12:14:33.930077 bus /gobi_6: Setting Powered False 12:14:34.994485 run create_hlr_db(pid=19051): Terminated: ok {rc=0} 12:14:35.427588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19053): Launched 12:14:35.731066 run osmo-hlr_10.42.42.2(pid=19054): Launched 12:14:35.846859 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:36.370033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19056): Launched 12:14:36.671633 run osmo-stp_10.42.42.5(pid=19057): Launched 12:14:36.786972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:37.308458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19059): Launched 12:14:37.424242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:37.678850 run patchelf(pid=19060): Launched 12:14:37.849700 run osmo-stp_10.42.42.5(pid=19057): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19057)] 12:14:37.977315 run osmo-stp_10.42.42.5(pid=19057): stdout: | (launched: 2022-12-13_12:14:36.616106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:38.106303 run osmo-stp_10.42.42.5(pid=19057): stderr: | 20221213121436782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121436782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121436783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121436783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121436783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121436783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121436784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:38.235255 run osmo-stp_10.42.42.5(pid=19057): stdout: | (launched: 2022-12-13_12:14:36.616106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:38.358421 run osmo-stp_10.42.42.5(pid=19057): stderr: | 20221213121436782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121436782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121436783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121436783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121436783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121436783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121436784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:38.504541 run patchelf(pid=19060): Terminating (SIGINT) 12:14:38.673100 run patchelf(pid=19060): Terminated: ok {rc=0} 12:14:38.794553 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19057): Process ended prematurely: osmo-stp_10.42.42.5(pid=19057) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19057)] [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 12:14:38.803621 tst ping.py:22: Test FAILED (6.4 sec) 12:14:38.830506 run osmo-hlr_10.42.42.2(pid=19054): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19054)] 12:14:38.878127 run osmo-hlr_10.42.42.2(pid=19054): stdout: | (launched: 2022-12-13_12:14:35.675000) 12:14:38.927170 run osmo-hlr_10.42.42.2(pid=19054): stderr: | 20221213121435848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121435848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121435848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121435848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121435848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121435848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121435861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121435869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121435869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121435869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:38.976757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19053): Terminating (SIGTERM) 12:14:39.016630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19056): Terminating (SIGTERM) 12:14:39.056447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19059): Terminating (SIGTERM) 12:14:39.096598 --- ParallelTerminationStrategy: PID 19053 died... 12:14:39.116221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19053): Terminated: ok {rc=0} 12:14:39.160581 --- ParallelTerminationStrategy: PID 19056 died... 12:14:39.179448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19056): Terminated: ok {rc=0} 12:14:39.223432 --- ParallelTerminationStrategy: PID 19059 died... 12:14:39.242179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19059): Terminated: ok {rc=0} 12:14:39.326074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:14:40.413838 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:40.426487 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:14:40.480430 tst ping_idle_ping.py: using LAC 33872 12:14:40.608504 tst ping_idle_ping.py: using RAC 212 12:14:40.736732 tst ping_idle_ping.py: using CellId 33872 12:14:40.856805 tst ping_idle_ping.py: using BVCI 33873 12:14:40.966921 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:40.977898 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:40.988588 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:40.999295 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:41.009935 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:41.020407 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:41.031707 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:14:41.042539 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:14:41.157676 tst ping_idle_ping.py:24: start network... 12:14:41.361308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:41.834236 run create_hlr_db(pid=19061): Launched 12:14:41.959946 bus /gobi_6: Setting Powered False 12:14:43.021755 run create_hlr_db(pid=19061): Terminated: ok {rc=0} 12:14:43.466959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19063): Launched 12:14:43.797174 run osmo-hlr_10.42.42.2(pid=19064): Launched 12:14:43.922922 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:44.487974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19066): Launched 12:14:44.815834 run osmo-stp_10.42.42.5(pid=19067): Launched 12:14:44.940384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:45.503610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19069): Launched 12:14:45.629448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:45.929337 run patchelf(pid=19070): Launched 12:14:46.112919 run osmo-stp_10.42.42.5(pid=19067): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19067)] 12:14:46.244559 run osmo-stp_10.42.42.5(pid=19067): stdout: | (launched: 2022-12-13_12:14:44.756207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:46.381982 run osmo-stp_10.42.42.5(pid=19067): stderr: | 20221213121444944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121444944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121444944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121444945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121444945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121444945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121444945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:46.516350 run osmo-stp_10.42.42.5(pid=19067): stdout: | (launched: 2022-12-13_12:14:44.756207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:46.643885 run osmo-stp_10.42.42.5(pid=19067): stderr: | 20221213121444944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121444944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121444944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121444945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121444945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121444945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121444945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:46.795639 run patchelf(pid=19070): Terminating (SIGINT) 12:14:46.970434 run patchelf(pid=19070): Terminated: ok {rc=0} 12:14:47.095174 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19067): Process ended prematurely: osmo-stp_10.42.42.5(pid=19067) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19067)] [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 12:14:47.106012 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:14:47.134462 run osmo-hlr_10.42.42.2(pid=19064): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19064)] 12:14:47.184565 run osmo-hlr_10.42.42.2(pid=19064): stdout: | (launched: 2022-12-13_12:14:43.736937) 12:14:47.236081 run osmo-hlr_10.42.42.2(pid=19064): stderr: | 20221213121443931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121443931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121443931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121443931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121443931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121443931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121443943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121443951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121443952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121443952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:47.288937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19063): Terminating (SIGTERM) 12:14:47.330983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19066): Terminating (SIGTERM) 12:14:47.371300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19069): Terminating (SIGTERM) 12:14:47.411836 --- ParallelTerminationStrategy: PID 19063 died... 12:14:47.431037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19063): Terminated: ok {rc=0} 12:14:47.475768 --- ParallelTerminationStrategy: PID 19066 died... 12:14:47.494653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19066): Terminated: ok {rc=0} 12:14:47.539226 --- ParallelTerminationStrategy: PID 19069 died... 12:14:47.558232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19069): Terminated: ok {rc=0} 12:14:47.645159 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:14:48.949579 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:14:48.955374 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:14:48.987615 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:14:49.026202 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:14:49.112605 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:14:49.145164 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:14:49.183519 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:14:49.784137 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:14:49.838791 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:49.850388 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:14:49.920884 tst cs_paging_gprs_active.py: using LAC 33873 12:14:50.049954 tst cs_paging_gprs_active.py: using RAC 213 12:14:50.178331 tst cs_paging_gprs_active.py: using CellId 33873 12:14:50.309952 tst cs_paging_gprs_active.py: using BVCI 33874 12:14:50.431069 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:50.442518 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:50.453881 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:50.465166 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:50.476644 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:50.488188 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:50.499956 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:50.511433 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:14:50.523349 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:14:50.642272 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:14:50.764300 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:14:50.989573 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:51.323134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19075): Launched 12:14:51.614978 run iperf3-srv_10.42.42.10(pid=19076): Launched 12:14:51.742352 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:14:51.967322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:52.301890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19077): Launched 12:14:52.592688 run iperf3-srv_10.42.42.10(pid=19078): Launched 12:14:52.719766 tst cs_paging_gprs_active.py:38: start network... 12:14:52.944198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:53.458337 run create_hlr_db(pid=19079): Launched 12:14:53.587323 bus /gobi_6: Setting Powered False 12:14:54.653742 run create_hlr_db(pid=19079): Terminated: ok {rc=0} 12:14:55.115146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19081): Launched 12:14:55.449202 run osmo-hlr_10.42.42.2(pid=19082): Launched 12:14:55.575816 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:56.150664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19084): Launched 12:14:56.484214 run osmo-stp_10.42.42.5(pid=19085): Launched 12:14:56.613106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:57.185316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19087): Launched 12:14:57.314285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:57.603564 run patchelf(pid=19088): Launched 12:14:57.790244 run osmo-stp_10.42.42.5(pid=19085): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19085)] 12:14:57.931369 run osmo-stp_10.42.42.5(pid=19085): stdout: | (launched: 2022-12-13_12:14:56.423678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:58.074264 run osmo-stp_10.42.42.5(pid=19085): stderr: | 20221213121456616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121456617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121456617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121456617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121456618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121456618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121456618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:58.217264 run osmo-stp_10.42.42.5(pid=19085): stdout: | (launched: 2022-12-13_12:14:56.423678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:58.353590 run osmo-stp_10.42.42.5(pid=19085): stderr: | 20221213121456616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121456617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121456617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121456617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121456618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121456618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121456618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:58.515020 run patchelf(pid=19088): Terminating (SIGINT) 12:14:58.701171 run patchelf(pid=19088): Terminated: ok {rc=0} 12:14:58.835760 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19085): Process ended prematurely: osmo-stp_10.42.42.5(pid=19085) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19085)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:14:58.846263 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 12:14:58.875402 run osmo-hlr_10.42.42.2(pid=19082): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19082)] 12:14:58.926614 run osmo-hlr_10.42.42.2(pid=19082): stdout: | (launched: 2022-12-13_12:14:55.388693) 12:14:58.979246 run osmo-hlr_10.42.42.2(pid=19082): stderr: | 20221213121455585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121455586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121455586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121455586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121455586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121455586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121455598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121455606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121455606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121455606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:59.032243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19075): Terminating (SIGTERM) 12:14:59.074423 run iperf3-srv_10.42.42.10(pid=19076): Terminating (SIGTERM) 12:14:59.116886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19077): Terminating (SIGTERM) 12:14:59.159450 run iperf3-srv_10.42.42.10(pid=19078): Terminating (SIGTERM) 12:14:59.201811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19081): Terminating (SIGTERM) 12:14:59.244173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19084): Terminating (SIGTERM) 12:14:59.286692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19087): Terminating (SIGTERM) 12:14:59.329779 --- ParallelTerminationStrategy: PID 19075 died... 12:14:59.350370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19075): Terminated: ok {rc=0} 12:14:59.397156 --- ParallelTerminationStrategy: PID 19076 died... 12:14:59.416907 run iperf3-srv_10.42.42.10(pid=19076): Terminated {rc=256} 12:14:59.463730 --- ParallelTerminationStrategy: PID 19077 died... 12:14:59.483780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19077): Terminated: ok {rc=0} 12:14:59.530368 --- ParallelTerminationStrategy: PID 19078 died... 12:14:59.550415 run iperf3-srv_10.42.42.10(pid=19078): Terminated {rc=256} 12:14:59.597026 --- ParallelTerminationStrategy: PID 19081 died... 12:14:59.617538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19081): Terminated: ok {rc=0} 12:14:59.664218 --- ParallelTerminationStrategy: PID 19084 died... 12:14:59.684328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19084): Terminated: ok {rc=0} 12:14:59.731372 --- ParallelTerminationStrategy: PID 19087 died... 12:14:59.751437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19087): Terminated: ok {rc=0} 12:14:59.841139 bus /gobi_0: Setting Powered False 12:15:00.951158 bus /gobi_0: Setting Powered False 12:15:02.085874 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:15:03.232159 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:03.243600 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:15:03.313112 tst iperf3.py: using LAC 33874 12:15:03.436130 tst iperf3.py: using RAC 214 12:15:03.570194 tst iperf3.py: using CellId 33874 12:15:03.700090 tst iperf3.py: using BVCI 33875 12:15:03.823279 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:03.834945 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:03.846534 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:03.857985 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:03.869723 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:03.881578 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:03.893435 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:03.905065 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:03.916816 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:15:04.037213 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:15:04.262173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:04.594880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19092): Launched 12:15:04.885653 run iperf3-srv_10.42.42.10(pid=19093): Launched 12:15:05.010493 tst iperf3.py:8: start network... 12:15:05.235699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:05.749075 run create_hlr_db(pid=19094): Launched 12:15:05.874834 bus /gobi_6: Setting Powered False 12:15:06.940216 run create_hlr_db(pid=19094): Terminated: ok {rc=0} 12:15:07.398606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19096): Launched 12:15:07.729288 run osmo-hlr_10.42.42.2(pid=19097): Launched 12:15:07.856145 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:08.520854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19099): Launched 12:15:08.844490 run osmo-stp_10.42.42.5(pid=19100): Launched 12:15:08.967529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:09.525347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19102): Launched 12:15:09.649932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:09.924389 run patchelf(pid=19103): Launched 12:15:10.105073 run osmo-stp_10.42.42.5(pid=19100): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19100)] 12:15:10.242428 run osmo-stp_10.42.42.5(pid=19100): stdout: | (launched: 2022-12-13_12:15:08.785610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:10.381069 run osmo-stp_10.42.42.5(pid=19100): stderr: | 20221213121508972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121508972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121508973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121508973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121508974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121508974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121508974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:10.519764 run osmo-stp_10.42.42.5(pid=19100): stdout: | (launched: 2022-12-13_12:15:08.785610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:10.652495 run osmo-stp_10.42.42.5(pid=19100): stderr: | 20221213121508972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121508972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121508973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121508973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121508974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121508974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121508974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:10.810197 run patchelf(pid=19103): Terminating (SIGINT) 12:15:10.991088 run patchelf(pid=19103): Terminated: ok {rc=0} 12:15:11.121998 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19100): Process ended prematurely: osmo-stp_10.42.42.5(pid=19100) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19100)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 12:15:11.132346 tst iperf3.py:8: Test FAILED (7.9 sec) 12:15:11.161129 run osmo-hlr_10.42.42.2(pid=19097): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19097)] 12:15:11.211781 run osmo-hlr_10.42.42.2(pid=19097): stdout: | (launched: 2022-12-13_12:15:07.669028) 12:15:11.263776 run osmo-hlr_10.42.42.2(pid=19097): stderr: | 20221213121507863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121507863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121507863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121507863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121507863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121507863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121507876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121507884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121507885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121507885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:11.316668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19092): Terminating (SIGTERM) 12:15:11.358592 run iperf3-srv_10.42.42.10(pid=19093): Terminating (SIGTERM) 12:15:11.401483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19096): Terminating (SIGTERM) 12:15:11.444019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19099): Terminating (SIGTERM) 12:15:11.486540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19102): Terminating (SIGTERM) 12:15:11.529548 --- ParallelTerminationStrategy: PID 19092 died... 12:15:11.550079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19092): Terminated: ok {rc=0} 12:15:11.597001 --- ParallelTerminationStrategy: PID 19093 died... 12:15:11.616745 run iperf3-srv_10.42.42.10(pid=19093): Terminated {rc=256} 12:15:11.663565 --- ParallelTerminationStrategy: PID 19096 died... 12:15:11.683714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19096): Terminated: ok {rc=0} 12:15:11.730790 --- ParallelTerminationStrategy: PID 19099 died... 12:15:11.750765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19099): Terminated: ok {rc=0} 12:15:11.797475 --- ParallelTerminationStrategy: PID 19102 died... 12:15:11.817487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19102): Terminated: ok {rc=0} 12:15:11.907093 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:15:13.058288 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:13.070329 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:15:13.141088 tst iperf3m4.py: using LAC 33875 12:15:13.265859 tst iperf3m4.py: using RAC 215 12:15:13.393684 tst iperf3m4.py: using CellId 33875 12:15:13.520489 tst iperf3m4.py: using BVCI 33876 12:15:13.632347 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:13.643460 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:13.654385 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:13.665371 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:13.676502 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:13.687610 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:13.699584 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:13.710207 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:13.720888 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:15:13.836816 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:15:13.959323 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:15:14.080059 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:15:14.200597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:15:14.404928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:14.709968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19104): Launched 12:15:14.974885 run iperf3-srv_10.42.42.10(pid=19105): Launched 12:15:15.088286 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:15:15.291704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:15.597506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19106): Launched 12:15:15.869746 run iperf3-srv_10.42.42.10(pid=19107): Launched 12:15:16.005680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:15:16.213737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:16.531853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19108): Launched 12:15:16.812775 run iperf3-srv_10.42.42.10(pid=19109): Launched 12:15:16.951226 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:15:17.159945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:17.466254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19110): Launched 12:15:17.731314 run iperf3-srv_10.42.42.10(pid=19111): Launched 12:15:17.844659 tst iperf3m4.py:8: start network... 12:15:18.047164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:18.519413 run create_hlr_db(pid=19112): Launched 12:15:18.643881 bus /gobi_6: Setting Powered False 12:15:19.704263 run create_hlr_db(pid=19112): Terminated: ok {rc=0} 12:15:20.149481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19114): Launched 12:15:20.477378 run osmo-hlr_10.42.42.2(pid=19115): Launched 12:15:20.603098 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:21.168853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19117): Launched 12:15:21.493441 run osmo-stp_10.42.42.5(pid=19118): Launched 12:15:21.619139 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:22.182288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19120): Launched 12:15:22.307122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:22.581926 run patchelf(pid=19121): Launched 12:15:22.764171 run osmo-stp_10.42.42.5(pid=19118): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19118)] 12:15:22.902627 run osmo-stp_10.42.42.5(pid=19118): stdout: | (launched: 2022-12-13_12:15:21.434541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:23.041725 run osmo-stp_10.42.42.5(pid=19118): stderr: | 20221213121521622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121521622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121521622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121521622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121521623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121521623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121521623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:23.181540 run osmo-stp_10.42.42.5(pid=19118): stdout: | (launched: 2022-12-13_12:15:21.434541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:23.315068 run osmo-stp_10.42.42.5(pid=19118): stderr: | 20221213121521622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121521622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121521622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121521622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121521623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121521623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121521623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:23.472786 run patchelf(pid=19121): Terminating (SIGINT) 12:15:23.654293 run patchelf(pid=19121): Terminated: ok {rc=0} 12:15:23.786188 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19118): Process ended prematurely: osmo-stp_10.42.42.5(pid=19118) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19118)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:15:23.796687 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:15:23.825865 run osmo-hlr_10.42.42.2(pid=19115): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19115)] 12:15:23.876838 run osmo-hlr_10.42.42.2(pid=19115): stdout: | (launched: 2022-12-13_12:15:20.417591) 12:15:23.929519 run osmo-hlr_10.42.42.2(pid=19115): stderr: | 20221213121520612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121520612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121520612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121520612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121520612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121520612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121520623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121520632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121520632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121520632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:23.982504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19104): Terminating (SIGTERM) 12:15:24.024815 run iperf3-srv_10.42.42.10(pid=19105): Terminating (SIGTERM) 12:15:24.067615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19106): Terminating (SIGTERM) 12:15:24.110445 run iperf3-srv_10.42.42.10(pid=19107): Terminating (SIGTERM) 12:15:24.154494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19108): Terminating (SIGTERM) 12:15:24.197509 run iperf3-srv_10.42.42.10(pid=19109): Terminating (SIGTERM) 12:15:24.239956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19110): Terminating (SIGTERM) 12:15:24.281924 run iperf3-srv_10.42.42.10(pid=19111): Terminating (SIGTERM) 12:15:24.324345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19114): Terminating (SIGTERM) 12:15:24.366959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19117): Terminating (SIGTERM) 12:15:24.409251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19120): Terminating (SIGTERM) 12:15:24.451777 --- ParallelTerminationStrategy: PID 19104 died... 12:15:24.472176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19104): Terminated: ok {rc=0} 12:15:24.518813 --- ParallelTerminationStrategy: PID 19105 died... 12:15:24.538733 run iperf3-srv_10.42.42.10(pid=19105): Terminated {rc=256} 12:15:24.584879 --- ParallelTerminationStrategy: PID 19106 died... 12:15:24.604993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19106): Terminated: ok {rc=0} 12:15:24.651338 --- ParallelTerminationStrategy: PID 19107 died... 12:15:24.671223 run iperf3-srv_10.42.42.10(pid=19107): Terminated {rc=256} 12:15:24.717272 --- ParallelTerminationStrategy: PID 19108 died... 12:15:24.737292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19108): Terminated: ok {rc=0} 12:15:24.783586 --- ParallelTerminationStrategy: PID 19109 died... 12:15:24.803504 run iperf3-srv_10.42.42.10(pid=19109): Terminated {rc=256} 12:15:24.849605 --- ParallelTerminationStrategy: PID 19110 died... 12:15:24.869642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19110): Terminated: ok {rc=0} 12:15:24.916085 --- ParallelTerminationStrategy: PID 19111 died... 12:15:24.936031 run iperf3-srv_10.42.42.10(pid=19111): Terminated {rc=256} 12:15:24.982118 --- ParallelTerminationStrategy: PID 19114 died... 12:15:25.002028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19114): Terminated: ok {rc=0} 12:15:25.048030 --- ParallelTerminationStrategy: PID 19117 died... 12:15:25.067981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19117): Terminated: ok {rc=0} 12:15:25.114149 --- ParallelTerminationStrategy: PID 19120 died... 12:15:25.134051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19120): Terminated: ok {rc=0} 12:15:25.222954 bus /gobi_4: Setting Powered False 12:15:26.321996 bus /gobi_4: Setting Powered False 12:15:27.437612 bus /gobi_1: Setting Powered False 12:15:28.533955 bus /gobi_1: Setting Powered False 12:15:29.650667 bus /gobi_0: Setting Powered False 12:15:30.749833 bus /gobi_0: Setting Powered False 12:15:31.863187 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:15:32.965567 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:32.977252 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:15:33.047862 tst ping.py: using LAC 33876 12:15:33.167613 tst ping.py: using RAC 216 12:15:33.293805 tst ping.py: using CellId 33876 12:15:33.418697 tst ping.py: using BVCI 33877 12:15:33.536418 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:33.548110 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:33.559548 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:33.570992 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:33.582638 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:33.594374 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:33.606173 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:33.617997 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:15:33.737922 tst ping.py:19: start network... 12:15:33.954129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:34.450968 run create_hlr_db(pid=19122): Launched 12:15:34.573906 bus /gobi_6: Setting Powered False 12:15:35.637605 run create_hlr_db(pid=19122): Terminated: ok {rc=0} 12:15:36.067942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19124): Launched 12:15:36.369282 run osmo-hlr_10.42.42.2(pid=19125): Launched 12:15:36.483477 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:37.003567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19127): Launched 12:15:37.304715 run osmo-stp_10.42.42.5(pid=19128): Launched 12:15:37.418977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:37.938575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19130): Launched 12:15:38.053282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:38.307281 run patchelf(pid=19131): Launched 12:15:38.474117 run osmo-stp_10.42.42.5(pid=19128): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19128)] 12:15:38.601247 run osmo-stp_10.42.42.5(pid=19128): stdout: | (launched: 2022-12-13_12:15:37.248654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:38.729997 run osmo-stp_10.42.42.5(pid=19128): stderr: | 20221213121537418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121537418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121537419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121537419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121537419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121537420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121537420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:38.859271 run osmo-stp_10.42.42.5(pid=19128): stdout: | (launched: 2022-12-13_12:15:37.248654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:38.982185 run osmo-stp_10.42.42.5(pid=19128): stderr: | 20221213121537418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121537418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121537419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121537419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121537419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121537420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121537420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:39.128012 run patchelf(pid=19131): Terminating (SIGINT) 12:15:39.295469 run patchelf(pid=19131): Terminated: ok {rc=0} 12:15:39.416394 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19128): Process ended prematurely: osmo-stp_10.42.42.5(pid=19128) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19128)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 12:15:39.425591 tst ping.py:22: Test FAILED (6.5 sec) 12:15:39.452595 run osmo-hlr_10.42.42.2(pid=19125): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19125)] 12:15:39.500762 run osmo-hlr_10.42.42.2(pid=19125): stdout: | (launched: 2022-12-13_12:15:36.313877) 12:15:39.550707 run osmo-hlr_10.42.42.2(pid=19125): stderr: | 20221213121536486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121536486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121536486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121536486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121536486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121536486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121536499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121536508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121536508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121536508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:39.601375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19124): Terminating (SIGTERM) 12:15:39.641533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19127): Terminating (SIGTERM) 12:15:39.681481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19130): Terminating (SIGTERM) 12:15:39.721778 --- ParallelTerminationStrategy: PID 19124 died... 12:15:39.741050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19124): Terminated: ok {rc=0} 12:15:39.785471 --- ParallelTerminationStrategy: PID 19127 died... 12:15:39.804371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19127): Terminated: ok {rc=0} 12:15:39.848722 --- ParallelTerminationStrategy: PID 19130 died... 12:15:39.867772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19130): Terminated: ok {rc=0} 12:15:39.955305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:15:41.045469 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:41.057602 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:15:41.135458 tst ping_idle_ping.py: using LAC 33877 12:15:41.260910 tst ping_idle_ping.py: using RAC 217 12:15:41.384522 tst ping_idle_ping.py: using CellId 33877 12:15:41.508329 tst ping_idle_ping.py: using BVCI 33878 12:15:41.626740 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:41.638375 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:41.649848 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:41.661297 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:41.672837 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:41.684610 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:41.696447 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:15:41.708159 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:15:41.824552 tst ping_idle_ping.py:24: start network... 12:15:42.026587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:42.492712 run create_hlr_db(pid=19132): Launched 12:15:42.616917 bus /gobi_6: Setting Powered False 12:15:43.677644 run create_hlr_db(pid=19132): Terminated: ok {rc=0} 12:15:44.117240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19134): Launched 12:15:44.440717 run osmo-hlr_10.42.42.2(pid=19135): Launched 12:15:44.563377 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:45.123439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19137): Launched 12:15:45.447155 run osmo-stp_10.42.42.5(pid=19138): Launched 12:15:45.571900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:46.140795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19140): Launched 12:15:46.303085 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:46.568664 run patchelf(pid=19141): Launched 12:15:46.755799 run osmo-stp_10.42.42.5(pid=19138): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19138)] 12:15:46.887364 run osmo-stp_10.42.42.5(pid=19138): stdout: | (launched: 2022-12-13_12:15:45.388453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:47.021169 run osmo-stp_10.42.42.5(pid=19138): stderr: | 20221213121545577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121545577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121545578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121545578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121545578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121545578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121545579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:47.154364 run osmo-stp_10.42.42.5(pid=19138): stdout: | (launched: 2022-12-13_12:15:45.388453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:47.279983 run osmo-stp_10.42.42.5(pid=19138): stderr: | 20221213121545577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121545577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121545578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121545578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121545578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121545578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121545579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:47.427143 run patchelf(pid=19141): Terminating (SIGINT) 12:15:47.596506 run patchelf(pid=19141): Terminated: ok {rc=0} 12:15:47.718551 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19138): Process ended prematurely: osmo-stp_10.42.42.5(pid=19138) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19138)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:15:47.727860 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:15:47.755004 run osmo-hlr_10.42.42.2(pid=19135): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19135)] 12:15:47.803803 run osmo-hlr_10.42.42.2(pid=19135): stdout: | (launched: 2022-12-13_12:15:44.381704) 12:15:47.854040 run osmo-hlr_10.42.42.2(pid=19135): stderr: | 20221213121544578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121544578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121544578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121544578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121544578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121544578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121544591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121544599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121544599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121544599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:47.904533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19134): Terminating (SIGTERM) 12:15:47.944926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19137): Terminating (SIGTERM) 12:15:47.985357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19140): Terminating (SIGTERM) 12:15:48.025939 --- ParallelTerminationStrategy: PID 19134 died... 12:15:48.045301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19134): Terminated: ok {rc=0} 12:15:48.090075 --- ParallelTerminationStrategy: PID 19137 died... 12:15:48.108789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19137): Terminated: ok {rc=0} 12:15:48.153277 --- ParallelTerminationStrategy: PID 19140 died... 12:15:48.172065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19140): Terminated: ok {rc=0} 12:15:48.256689 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:15:49.557072 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:15:49.562979 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:15:49.595306 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:15:49.638192 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:15:49.729625 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:15:49.764120 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:15:49.804416 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:15:50.399454 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:15:50.453129 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:50.464653 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:15:50.536495 tst cs_paging_gprs_active.py: using LAC 33878 12:15:50.663572 tst cs_paging_gprs_active.py: using RAC 218 12:15:50.791777 tst cs_paging_gprs_active.py: using CellId 33878 12:15:50.919923 tst cs_paging_gprs_active.py: using BVCI 33879 12:15:51.040259 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:51.051742 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:51.063027 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:51.074361 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:51.085878 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:51.097662 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:51.109546 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:51.121321 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:15:51.133298 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:15:51.251640 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:15:51.376695 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:15:51.598396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:51.927897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19149): Launched 12:15:52.195776 run iperf3-srv_10.42.42.10(pid=19150): Launched 12:15:52.310995 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:15:52.516246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:52.823853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19151): Launched 12:15:53.091879 run iperf3-srv_10.42.42.10(pid=19152): Launched 12:15:53.206666 tst cs_paging_gprs_active.py:38: start network... 12:15:53.411439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:53.886155 run create_hlr_db(pid=19153): Launched 12:15:54.012521 bus /gobi_6: Setting Powered False 12:15:55.073881 run create_hlr_db(pid=19153): Terminated: ok {rc=0} 12:15:55.522666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19155): Launched 12:15:55.853191 run osmo-hlr_10.42.42.2(pid=19156): Launched 12:15:55.977383 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:56.544773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19158): Launched 12:15:56.873390 run osmo-stp_10.42.42.5(pid=19159): Launched 12:15:57.000222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:57.568102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19161): Launched 12:15:57.694324 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:57.973885 run patchelf(pid=19162): Launched 12:15:58.158124 run osmo-stp_10.42.42.5(pid=19159): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19159)] 12:15:58.297404 run osmo-stp_10.42.42.5(pid=19159): stdout: | (launched: 2022-12-13_12:15:56.813740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:58.439251 run osmo-stp_10.42.42.5(pid=19159): stderr: | 20221213121557003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121557003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121557004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121557004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121557004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121557005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121557005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:58.580560 run osmo-stp_10.42.42.5(pid=19159): stdout: | (launched: 2022-12-13_12:15:56.813740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:58.715151 run osmo-stp_10.42.42.5(pid=19159): stderr: | 20221213121557003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121557003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121557004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121557004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121557004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121557005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121557005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:58.875328 run patchelf(pid=19162): Terminating (SIGINT) 12:15:59.060024 run patchelf(pid=19162): Terminated: ok {rc=0} 12:15:59.193040 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19159): Process ended prematurely: osmo-stp_10.42.42.5(pid=19159) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19159)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:15:59.203422 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:15:59.232175 run osmo-hlr_10.42.42.2(pid=19156): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19156)] 12:15:59.283281 run osmo-hlr_10.42.42.2(pid=19156): stdout: | (launched: 2022-12-13_12:15:55.793204) 12:15:59.335734 run osmo-hlr_10.42.42.2(pid=19156): stderr: | 20221213121555990 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121555990 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121555990 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121555990 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121555990 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121555990 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121556003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121556013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121556013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121556013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:59.388532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19149): Terminating (SIGTERM) 12:15:59.430685 run iperf3-srv_10.42.42.10(pid=19150): Terminating (SIGTERM) 12:15:59.474418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19151): Terminating (SIGTERM) 12:15:59.516906 run iperf3-srv_10.42.42.10(pid=19152): Terminating (SIGTERM) 12:15:59.559302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19155): Terminating (SIGTERM) 12:15:59.601330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19158): Terminating (SIGTERM) 12:15:59.643764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19161): Terminating (SIGTERM) 12:15:59.685963 --- ParallelTerminationStrategy: PID 19149 died... 12:15:59.706158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19149): Terminated: ok {rc=0} 12:15:59.752785 --- ParallelTerminationStrategy: PID 19150 died... 12:15:59.772677 run iperf3-srv_10.42.42.10(pid=19150): Terminated {rc=256} 12:15:59.819004 --- ParallelTerminationStrategy: PID 19151 died... 12:15:59.838814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19151): Terminated: ok {rc=0} 12:15:59.885216 --- ParallelTerminationStrategy: PID 19152 died... 12:15:59.904899 run iperf3-srv_10.42.42.10(pid=19152): Terminated {rc=256} 12:15:59.951321 --- ParallelTerminationStrategy: PID 19155 died... 12:15:59.971105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19155): Terminated: ok {rc=0} 12:16:00.017401 --- ParallelTerminationStrategy: PID 19158 died... 12:16:00.037425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19158): Terminated: ok {rc=0} 12:16:00.083675 --- ParallelTerminationStrategy: PID 19161 died... 12:16:00.103527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19161): Terminated: ok {rc=0} 12:16:00.192567 bus /gobi_0: Setting Powered False 12:16:01.290899 bus /gobi_0: Setting Powered False 12:16:02.420328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:16:03.571701 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:03.583848 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:16:03.658295 tst iperf3.py: using LAC 33879 12:16:03.788014 tst iperf3.py: using RAC 219 12:16:03.915284 tst iperf3.py: using CellId 33879 12:16:04.042338 tst iperf3.py: using BVCI 33880 12:16:04.160915 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:04.172474 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:04.183742 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:04.195052 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:04.206627 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:04.218243 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:04.229980 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:04.241492 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:04.253209 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:16:04.374297 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:16:04.595048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:04.922684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19163): Launched 12:16:05.208419 run iperf3-srv_10.42.42.10(pid=19164): Launched 12:16:05.331142 tst iperf3.py:8: start network... 12:16:05.551512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:06.056516 run create_hlr_db(pid=19165): Launched 12:16:06.181252 bus /gobi_6: Setting Powered False 12:16:07.245256 run create_hlr_db(pid=19165): Terminated: ok {rc=0} 12:16:07.680912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19167): Launched 12:16:07.986938 run osmo-hlr_10.42.42.2(pid=19168): Launched 12:16:08.102542 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:08.642968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19170): Launched 12:16:08.948319 run osmo-stp_10.42.42.5(pid=19171): Launched 12:16:09.063589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:09.592719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19173): Launched 12:16:09.710059 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:09.968596 run patchelf(pid=19174): Launched 12:16:10.138601 run osmo-stp_10.42.42.5(pid=19171): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19171)] 12:16:10.268029 run osmo-stp_10.42.42.5(pid=19171): stdout: | (launched: 2022-12-13_12:16:08.891966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:10.399278 run osmo-stp_10.42.42.5(pid=19171): stderr: | 20221213121609059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121609059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121609059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121609060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121609060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121609060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121609060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:10.531123 run osmo-stp_10.42.42.5(pid=19171): stdout: | (launched: 2022-12-13_12:16:08.891966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:10.656068 run osmo-stp_10.42.42.5(pid=19171): stderr: | 20221213121609059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121609059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121609059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121609060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121609060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121609060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121609060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:10.804333 run patchelf(pid=19174): Terminating (SIGINT) 12:16:10.975591 run patchelf(pid=19174): Terminated: ok {rc=0} 12:16:11.099386 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19171): Process ended prematurely: osmo-stp_10.42.42.5(pid=19171) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19171)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 12:16:11.109650 tst iperf3.py:8: Test FAILED (7.6 sec) 12:16:11.137177 run osmo-hlr_10.42.42.2(pid=19168): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19168)] 12:16:11.185250 run osmo-hlr_10.42.42.2(pid=19168): stdout: | (launched: 2022-12-13_12:16:07.930311) 12:16:11.235222 run osmo-hlr_10.42.42.2(pid=19168): stderr: | 20221213121608104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121608104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121608104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121608104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121608104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121608104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121608117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121608127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121608127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121608127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:11.285672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19163): Terminating (SIGTERM) 12:16:11.325922 run iperf3-srv_10.42.42.10(pid=19164): Terminating (SIGTERM) 12:16:11.366037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19167): Terminating (SIGTERM) 12:16:11.406290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19170): Terminating (SIGTERM) 12:16:11.446677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19173): Terminating (SIGTERM) 12:16:11.487039 --- ParallelTerminationStrategy: PID 19163 died... 12:16:11.506442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19163): Terminated: ok {rc=0} 12:16:11.550903 --- ParallelTerminationStrategy: PID 19164 died... 12:16:11.569636 run iperf3-srv_10.42.42.10(pid=19164): Terminated {rc=256} 12:16:11.613886 --- ParallelTerminationStrategy: PID 19167 died... 12:16:11.632663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19167): Terminated: ok {rc=0} 12:16:11.677123 --- ParallelTerminationStrategy: PID 19170 died... 12:16:11.695908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19170): Terminated: ok {rc=0} 12:16:11.740217 --- ParallelTerminationStrategy: PID 19173 died... 12:16:11.759126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19173): Terminated: ok {rc=0} 12:16:11.847044 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:16:12.995678 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:13.007239 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:16:13.081521 tst iperf3m4.py: using LAC 33880 12:16:13.200467 tst iperf3m4.py: using RAC 220 12:16:13.318165 tst iperf3m4.py: using CellId 33880 12:16:13.439865 tst iperf3m4.py: using BVCI 33881 12:16:13.551726 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:13.562762 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:13.573581 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:13.584428 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:13.595203 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:13.606077 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:13.617154 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:13.627868 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:13.638876 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:16:13.754397 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:16:13.877993 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:16:13.995671 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:16:14.111028 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:16:14.316057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:14.623326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19175): Launched 12:16:14.889749 run iperf3-srv_10.42.42.10(pid=19176): Launched 12:16:15.004556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:16:15.211167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:15.519187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19177): Launched 12:16:15.787484 run iperf3-srv_10.42.42.10(pid=19178): Launched 12:16:15.907245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:16:16.119940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:16.431658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19179): Launched 12:16:16.796252 run iperf3-srv_10.42.42.10(pid=19180): Launched 12:16:16.927596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:16:17.136918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:17.446688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19181): Launched 12:16:17.714377 run iperf3-srv_10.42.42.10(pid=19182): Launched 12:16:17.830398 tst iperf3m4.py:8: start network... 12:16:18.034641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:18.505531 run create_hlr_db(pid=19183): Launched 12:16:18.632284 bus /gobi_6: Setting Powered False 12:16:19.693844 run create_hlr_db(pid=19183): Terminated: ok {rc=0} 12:16:20.139593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19185): Launched 12:16:20.469119 run osmo-hlr_10.42.42.2(pid=19186): Launched 12:16:20.596266 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:21.163372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19188): Launched 12:16:21.490999 run osmo-stp_10.42.42.5(pid=19189): Launched 12:16:21.617218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:22.199798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19191): Launched 12:16:22.327012 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:22.603125 run patchelf(pid=19192): Launched 12:16:22.787248 run osmo-stp_10.42.42.5(pid=19189): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19189)] 12:16:22.926382 run osmo-stp_10.42.42.5(pid=19189): stdout: | (launched: 2022-12-13_12:16:21.431472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:23.066594 run osmo-stp_10.42.42.5(pid=19189): stderr: | 20221213121621619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121621620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121621620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121621620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121621621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121621621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121621621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:23.206890 run osmo-stp_10.42.42.5(pid=19189): stdout: | (launched: 2022-12-13_12:16:21.431472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:23.340668 run osmo-stp_10.42.42.5(pid=19189): stderr: | 20221213121621619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121621620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121621620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121621620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121621621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121621621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121621621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:23.498875 run patchelf(pid=19192): Terminating (SIGINT) 12:16:23.681976 run patchelf(pid=19192): Terminated: ok {rc=0} 12:16:23.814593 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19189): Process ended prematurely: osmo-stp_10.42.42.5(pid=19189) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19189)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:16:23.825093 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:16:23.854429 run osmo-hlr_10.42.42.2(pid=19186): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19186)] 12:16:23.906305 run osmo-hlr_10.42.42.2(pid=19186): stdout: | (launched: 2022-12-13_12:16:20.409481) 12:16:23.959352 run osmo-hlr_10.42.42.2(pid=19186): stderr: | 20221213121620607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121620607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121620607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121620607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121620607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121620607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121620619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121620628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121620629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121620629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:24.013095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19175): Terminating (SIGTERM) 12:16:24.055669 run iperf3-srv_10.42.42.10(pid=19176): Terminating (SIGTERM) 12:16:24.098683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19177): Terminating (SIGTERM) 12:16:24.141753 run iperf3-srv_10.42.42.10(pid=19178): Terminating (SIGTERM) 12:16:24.184593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19179): Terminating (SIGTERM) 12:16:24.227520 run iperf3-srv_10.42.42.10(pid=19180): Terminating (SIGTERM) 12:16:24.270534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19181): Terminating (SIGTERM) 12:16:24.313654 run iperf3-srv_10.42.42.10(pid=19182): Terminating (SIGTERM) 12:16:24.356586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19185): Terminating (SIGTERM) 12:16:24.399654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19188): Terminating (SIGTERM) 12:16:24.442542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19191): Terminating (SIGTERM) 12:16:24.485811 --- ParallelTerminationStrategy: PID 19175 died... 12:16:24.506586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19175): Terminated: ok {rc=0} 12:16:24.554243 --- ParallelTerminationStrategy: PID 19176 died... 12:16:24.574492 run iperf3-srv_10.42.42.10(pid=19176): Terminated {rc=256} 12:16:24.621851 --- ParallelTerminationStrategy: PID 19177 died... 12:16:24.642127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19177): Terminated: ok {rc=0} 12:16:24.689636 --- ParallelTerminationStrategy: PID 19178 died... 12:16:24.710003 run iperf3-srv_10.42.42.10(pid=19178): Terminated {rc=256} 12:16:24.757447 --- ParallelTerminationStrategy: PID 19179 died... 12:16:24.777717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19179): Terminated: ok {rc=0} 12:16:24.825118 --- ParallelTerminationStrategy: PID 19180 died... 12:16:24.845476 run iperf3-srv_10.42.42.10(pid=19180): Terminated {rc=256} 12:16:24.892653 --- ParallelTerminationStrategy: PID 19181 died... 12:16:24.913078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19181): Terminated: ok {rc=0} 12:16:24.960224 --- ParallelTerminationStrategy: PID 19182 died... 12:16:24.980572 run iperf3-srv_10.42.42.10(pid=19182): Terminated {rc=256} 12:16:25.027776 --- ParallelTerminationStrategy: PID 19185 died... 12:16:25.048052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19185): Terminated: ok {rc=0} 12:16:25.095201 --- ParallelTerminationStrategy: PID 19188 died... 12:16:25.115382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19188): Terminated: ok {rc=0} 12:16:25.162392 --- ParallelTerminationStrategy: PID 19191 died... 12:16:25.182607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19191): Terminated: ok {rc=0} 12:16:25.272053 bus /gobi_4: Setting Powered False 12:16:26.372003 bus /gobi_4: Setting Powered False 12:16:27.488478 bus /gobi_1: Setting Powered False 12:16:28.587516 bus /gobi_1: Setting Powered False 12:16:29.707429 bus /gobi_0: Setting Powered False 12:16:30.805908 bus /gobi_0: Setting Powered False 12:16:31.925216 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:16:33.031979 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:33.043941 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:16:33.116900 tst ping.py: using LAC 33881 12:16:33.243894 tst ping.py: using RAC 221 12:16:33.374209 tst ping.py: using CellId 33881 12:16:33.508374 tst ping.py: using BVCI 33882 12:16:33.619944 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:33.631135 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:33.642169 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:33.653175 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:33.664687 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:33.675842 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:33.686846 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:33.697747 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:16:33.817488 tst ping.py:19: start network... 12:16:34.034525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:34.531980 run create_hlr_db(pid=19193): Launched 12:16:34.657530 bus /gobi_6: Setting Powered False 12:16:35.721288 run create_hlr_db(pid=19193): Terminated: ok {rc=0} 12:16:36.170667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19195): Launched 12:16:36.491737 run osmo-hlr_10.42.42.2(pid=19196): Launched 12:16:36.614505 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:37.172408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19198): Launched 12:16:37.492472 run osmo-stp_10.42.42.5(pid=19199): Launched 12:16:37.614567 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:38.165720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19201): Launched 12:16:38.289163 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:38.560470 run patchelf(pid=19202): Launched 12:16:38.738663 run osmo-stp_10.42.42.5(pid=19199): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19199)] 12:16:38.875367 run osmo-stp_10.42.42.5(pid=19199): stdout: | (launched: 2022-12-13_12:16:37.434095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:39.013252 run osmo-stp_10.42.42.5(pid=19199): stderr: | 20221213121637622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121637623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121637623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121637623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121637624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121637624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121637624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:39.151319 run osmo-stp_10.42.42.5(pid=19199): stdout: | (launched: 2022-12-13_12:16:37.434095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:39.283111 run osmo-stp_10.42.42.5(pid=19199): stderr: | 20221213121637622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121637623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121637623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121637623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121637624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121637624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121637624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:39.439111 run patchelf(pid=19202): Terminating (SIGINT) 12:16:39.618115 run patchelf(pid=19202): Terminated: ok {rc=0} 12:16:39.747449 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19199): Process ended prematurely: osmo-stp_10.42.42.5(pid=19199) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19199)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 12:16:39.757655 tst ping.py:22: Test FAILED (6.7 sec) 12:16:39.786168 run osmo-hlr_10.42.42.2(pid=19196): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19196)] 12:16:39.838241 run osmo-hlr_10.42.42.2(pid=19196): stdout: | (launched: 2022-12-13_12:16:36.433246) 12:16:39.891214 run osmo-hlr_10.42.42.2(pid=19196): stderr: | 20221213121636626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121636626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121636626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121636626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121636626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121636626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121636639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121636647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121636647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121636647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:39.944456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19195): Terminating (SIGTERM) 12:16:39.986915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19198): Terminating (SIGTERM) 12:16:40.029667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19201): Terminating (SIGTERM) 12:16:40.072291 --- ParallelTerminationStrategy: PID 19195 died... 12:16:40.092830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19195): Terminated: ok {rc=0} 12:16:40.139721 --- ParallelTerminationStrategy: PID 19198 died... 12:16:40.159843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19198): Terminated: ok {rc=0} 12:16:40.206512 --- ParallelTerminationStrategy: PID 19201 died... 12:16:40.226610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19201): Terminated: ok {rc=0} 12:16:40.316002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:16:41.402474 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:41.414622 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:16:41.492617 tst ping_idle_ping.py: using LAC 33882 12:16:41.620090 tst ping_idle_ping.py: using RAC 222 12:16:41.747718 tst ping_idle_ping.py: using CellId 33882 12:16:41.875046 tst ping_idle_ping.py: using BVCI 33883 12:16:41.994199 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:42.005674 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:42.016902 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:42.028192 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:42.040122 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:42.052136 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:42.064278 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:16:42.076516 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:16:42.194457 tst ping_idle_ping.py:24: start network... 12:16:42.397158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:42.866451 run create_hlr_db(pid=19203): Launched 12:16:42.992301 bus /gobi_6: Setting Powered False 12:16:44.052770 run create_hlr_db(pid=19203): Terminated: ok {rc=0} 12:16:44.494545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19205): Launched 12:16:44.818527 run osmo-hlr_10.42.42.2(pid=19206): Launched 12:16:44.943349 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:45.500937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19208): Launched 12:16:45.836284 run osmo-stp_10.42.42.5(pid=19209): Launched 12:16:46.109991 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:46.795952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19211): Launched 12:16:46.931975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:47.208815 run patchelf(pid=19212): Launched 12:16:47.389354 run osmo-stp_10.42.42.5(pid=19209): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19209)] 12:16:47.526308 run osmo-stp_10.42.42.5(pid=19209): stdout: | (launched: 2022-12-13_12:16:45.766890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:47.665233 run osmo-stp_10.42.42.5(pid=19209): stderr: | 20221213121646112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121646112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121646113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121646113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121646114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121646114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121646114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:47.803940 run osmo-stp_10.42.42.5(pid=19209): stdout: | (launched: 2022-12-13_12:16:45.766890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:47.936511 run osmo-stp_10.42.42.5(pid=19209): stderr: | 20221213121646112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121646112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121646113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121646113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121646114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121646114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121646114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:48.093590 run patchelf(pid=19212): Terminating (SIGINT) 12:16:48.273465 run patchelf(pid=19212): Terminated: ok {rc=0} 12:16:48.403263 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19209): Process ended prematurely: osmo-stp_10.42.42.5(pid=19209) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19209)] [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:16:48.413142 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 12:16:48.441959 run osmo-hlr_10.42.42.2(pid=19206): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19206)] 12:16:48.493138 run osmo-hlr_10.42.42.2(pid=19206): stdout: | (launched: 2022-12-13_12:16:44.759370) 12:16:48.546343 run osmo-hlr_10.42.42.2(pid=19206): stderr: | 20221213121644954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121644954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121644954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121644954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121644954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121644954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121644967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121644975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121644976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121644976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:48.599640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19205): Terminating (SIGTERM) 12:16:48.641970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19208): Terminating (SIGTERM) 12:16:48.684829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19211): Terminating (SIGTERM) 12:16:48.727811 --- ParallelTerminationStrategy: PID 19205 died... 12:16:48.748662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19205): Terminated: ok {rc=0} 12:16:48.796683 --- ParallelTerminationStrategy: PID 19208 died... 12:16:48.817288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19208): Terminated: ok {rc=0} 12:16:48.864242 --- ParallelTerminationStrategy: PID 19211 died... 12:16:48.884755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19211): Terminated: ok {rc=0} 12:16:48.975093 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:16:50.276611 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:16:50.283190 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:16:50.315971 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 12:16:50.354886 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 12:16:50.441204 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:16:50.473633 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 12:16:50.512177 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 12:16:51.120256 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 12:16:51.170134 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:16:51.181787 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:16:51.233290 tst cs_paging_gprs_active.py: using LAC 33883 12:16:51.352528 tst cs_paging_gprs_active.py: using RAC 223 12:16:51.471245 tst cs_paging_gprs_active.py: using CellId 33883 12:16:51.592457 tst cs_paging_gprs_active.py: using BVCI 33884 12:16:51.704792 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:16:51.716636 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:16:51.727832 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:16:51.739169 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:16:51.750535 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:16:51.761870 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:16:51.773331 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:16:51.784587 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:16:51.796129 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:16:51.913613 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:16:52.030950 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:16:52.237038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:52.544919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19217): Launched 12:16:52.812347 run iperf3-srv_10.42.42.10(pid=19218): Launched 12:16:52.927589 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:16:53.132335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:53.439463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19219): Launched 12:16:53.707122 run iperf3-srv_10.42.42.10(pid=19220): Launched 12:16:53.822157 tst cs_paging_gprs_active.py:38: start network... 12:16:54.026654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:54.501243 run create_hlr_db(pid=19221): Launched 12:16:54.626043 bus /gobi_6: Setting Powered False 12:16:55.687060 run create_hlr_db(pid=19221): Terminated: ok {rc=0} 12:16:56.135735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19223): Launched 12:16:56.464847 run osmo-hlr_10.42.42.2(pid=19224): Launched 12:16:56.592004 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:57.159704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19226): Launched 12:16:57.489554 run osmo-stp_10.42.42.5(pid=19227): Launched 12:16:57.615672 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:58.182104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19229): Launched 12:16:58.309568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:58.586829 run patchelf(pid=19230): Launched 12:16:58.769793 run osmo-stp_10.42.42.5(pid=19227): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19227)] 12:16:58.909045 run osmo-stp_10.42.42.5(pid=19227): stdout: | (launched: 2022-12-13_12:16:57.429635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:59.050075 run osmo-stp_10.42.42.5(pid=19227): stderr: | 20221213121657620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121657620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121657621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121657621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121657622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121657622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121657622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:59.190790 run osmo-stp_10.42.42.5(pid=19227): stdout: | (launched: 2022-12-13_12:16:57.429635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:59.325028 run osmo-stp_10.42.42.5(pid=19227): stderr: | 20221213121657620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121657620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121657621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121657621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121657622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121657622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121657622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:59.483969 run patchelf(pid=19230): Terminating (SIGINT) 12:16:59.667238 run patchelf(pid=19230): Terminated: ok {rc=0} 12:16:59.799267 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19227): Process ended prematurely: osmo-stp_10.42.42.5(pid=19227) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19227)] [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 12:16:59.809588 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:16:59.838521 run osmo-hlr_10.42.42.2(pid=19224): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19224)] 12:16:59.889304 run osmo-hlr_10.42.42.2(pid=19224): stdout: | (launched: 2022-12-13_12:16:56.405006) 12:16:59.941354 run osmo-hlr_10.42.42.2(pid=19224): stderr: | 20221213121656601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121656601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121656601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121656601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121656601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121656602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121656614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121656623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121656623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121656623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:59.994678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19217): Terminating (SIGTERM) 12:17:00.036400 run iperf3-srv_10.42.42.10(pid=19218): Terminating (SIGTERM) 12:17:00.078817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19219): Terminating (SIGTERM) 12:17:00.121065 run iperf3-srv_10.42.42.10(pid=19220): Terminating (SIGTERM) 12:17:00.163470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19223): Terminating (SIGTERM) 12:17:00.205733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19226): Terminating (SIGTERM) 12:17:00.247595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19229): Terminating (SIGTERM) 12:17:00.290478 --- ParallelTerminationStrategy: PID 19217 died... 12:17:00.310705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19217): Terminated: ok {rc=0} 12:17:00.357353 --- ParallelTerminationStrategy: PID 19218 died... 12:17:00.376942 run iperf3-srv_10.42.42.10(pid=19218): Terminated {rc=256} 12:17:00.423109 --- ParallelTerminationStrategy: PID 19219 died... 12:17:00.442878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19219): Terminated: ok {rc=0} 12:17:00.488822 --- ParallelTerminationStrategy: PID 19220 died... 12:17:00.509046 run iperf3-srv_10.42.42.10(pid=19220): Terminated {rc=256} 12:17:00.555127 --- ParallelTerminationStrategy: PID 19223 died... 12:17:00.575044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19223): Terminated: ok {rc=0} 12:17:00.621290 --- ParallelTerminationStrategy: PID 19226 died... 12:17:00.641024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19226): Terminated: ok {rc=0} 12:17:00.687337 --- ParallelTerminationStrategy: PID 19229 died... 12:17:00.707132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19229): Terminated: ok {rc=0} 12:17:00.795126 bus /gobi_0: Setting Powered False 12:17:01.915203 bus /gobi_0: Setting Powered False 12:17:03.031745 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 12:17:04.182392 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:04.194743 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:17:04.251097 tst iperf3.py: using LAC 33884 12:17:04.382385 tst iperf3.py: using RAC 224 12:17:04.503104 tst iperf3.py: using CellId 33884 12:17:04.632275 tst iperf3.py: using BVCI 33885 12:17:04.744709 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:04.756319 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:04.767729 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:04.779079 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:04.790604 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:04.802130 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:04.813797 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:04.825194 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:04.836709 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:17:04.956233 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:17:05.178505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:05.508237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19235): Launched 12:17:05.795254 run iperf3-srv_10.42.42.10(pid=19236): Launched 12:17:05.918916 tst iperf3.py:8: start network... 12:17:06.141202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:06.648611 run create_hlr_db(pid=19237): Launched 12:17:06.775318 bus /gobi_6: Setting Powered False 12:17:07.839572 run create_hlr_db(pid=19237): Terminated: ok {rc=0} 12:17:08.276309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19239): Launched 12:17:08.583211 run osmo-hlr_10.42.42.2(pid=19240): Launched 12:17:08.700664 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:09.228358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19242): Launched 12:17:09.535158 run osmo-stp_10.42.42.5(pid=19243): Launched 12:17:09.654543 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:10.184090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19245): Launched 12:17:10.301988 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:10.560643 run patchelf(pid=19246): Launched 12:17:10.731511 run osmo-stp_10.42.42.5(pid=19243): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19243)] 12:17:10.861575 run osmo-stp_10.42.42.5(pid=19243): stdout: | (launched: 2022-12-13_12:17:09.478764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:10.994614 run osmo-stp_10.42.42.5(pid=19243): stderr: | 20221213121709646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121709646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121709647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121709647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121709647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121709648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121709648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:11.126359 run osmo-stp_10.42.42.5(pid=19243): stdout: | (launched: 2022-12-13_12:17:09.478764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:11.251605 run osmo-stp_10.42.42.5(pid=19243): stderr: | 20221213121709646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121709646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121709647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121709647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121709647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121709648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121709648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:11.399997 run patchelf(pid=19246): Terminating (SIGINT) 12:17:11.572094 run patchelf(pid=19246): Terminated: ok {rc=0} 12:17:11.696537 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19243): Process ended prematurely: osmo-stp_10.42.42.5(pid=19243) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19243)] [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 12:17:11.706266 tst iperf3.py:8: Test FAILED (7.6 sec) 12:17:11.733656 run osmo-hlr_10.42.42.2(pid=19240): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19240)] 12:17:11.781895 run osmo-hlr_10.42.42.2(pid=19240): stdout: | (launched: 2022-12-13_12:17:08.526794) 12:17:11.831287 run osmo-hlr_10.42.42.2(pid=19240): stderr: | 20221213121708701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121708701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121708701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121708701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121708701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121708701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121708733 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121708743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121708743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121708743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:11.881524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19235): Terminating (SIGTERM) 12:17:11.921599 run iperf3-srv_10.42.42.10(pid=19236): Terminating (SIGTERM) 12:17:11.961561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19239): Terminating (SIGTERM) 12:17:12.001731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19242): Terminating (SIGTERM) 12:17:12.041980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19245): Terminating (SIGTERM) 12:17:12.082263 --- ParallelTerminationStrategy: PID 19235 died... 12:17:12.101657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19235): Terminated: ok {rc=0} 12:17:12.146075 --- ParallelTerminationStrategy: PID 19236 died... 12:17:12.165427 run iperf3-srv_10.42.42.10(pid=19236): Terminated {rc=256} 12:17:12.209397 --- ParallelTerminationStrategy: PID 19239 died... 12:17:12.228277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19239): Terminated: ok {rc=0} 12:17:12.272436 --- ParallelTerminationStrategy: PID 19242 died... 12:17:12.291352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19242): Terminated: ok {rc=0} 12:17:12.335453 --- ParallelTerminationStrategy: PID 19245 died... 12:17:12.354499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19245): Terminated: ok {rc=0} 12:17:12.438380 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 12:17:13.590408 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:13.602899 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:17:13.658204 tst iperf3m4.py: using LAC 33885 12:17:13.792001 tst iperf3m4.py: using RAC 225 12:17:13.921127 tst iperf3m4.py: using CellId 33885 12:17:14.047819 tst iperf3m4.py: using BVCI 33886 12:17:14.159833 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:14.171523 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:14.182906 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:14.194394 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:14.206091 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:14.217726 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:14.229425 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:14.240907 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:14.252660 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:17:14.373931 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:17:14.494428 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:17:14.615158 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:17:14.732516 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:17:14.939003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:15.246964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19247): Launched 12:17:15.514262 run iperf3-srv_10.42.42.10(pid=19248): Launched 12:17:15.630848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:17:15.843995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:16.233732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19249): Launched 12:17:16.536380 run iperf3-srv_10.42.42.10(pid=19250): Launched 12:17:16.676369 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:17:16.904445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:17.241339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19251): Launched 12:17:17.527537 run iperf3-srv_10.42.42.10(pid=19252): Launched 12:17:17.650642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:17:17.873034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:18.205839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19253): Launched 12:17:18.497971 run iperf3-srv_10.42.42.10(pid=19254): Launched 12:17:18.621755 tst iperf3m4.py:8: start network... 12:17:18.843596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:19.349514 run create_hlr_db(pid=19255): Launched 12:17:19.475179 bus /gobi_6: Setting Powered False 12:17:20.539994 run create_hlr_db(pid=19255): Terminated: ok {rc=0} 12:17:20.978665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19257): Launched 12:17:21.285332 run osmo-hlr_10.42.42.2(pid=19258): Launched 12:17:21.403704 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:21.929517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19260): Launched 12:17:22.235609 run osmo-stp_10.42.42.5(pid=19261): Launched 12:17:22.351708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:22.876904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19263): Launched 12:17:22.994239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:23.252426 run patchelf(pid=19264): Launched 12:17:23.422199 run osmo-stp_10.42.42.5(pid=19261): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19261)] 12:17:23.551187 run osmo-stp_10.42.42.5(pid=19261): stdout: | (launched: 2022-12-13_12:17:22.179113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:23.681514 run osmo-stp_10.42.42.5(pid=19261): stderr: | 20221213121722348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121722349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121722349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121722349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121722350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121722350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121722350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:23.811926 run osmo-stp_10.42.42.5(pid=19261): stdout: | (launched: 2022-12-13_12:17:22.179113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:23.936571 run osmo-stp_10.42.42.5(pid=19261): stderr: | 20221213121722348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121722349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121722349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121722349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121722350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121722350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121722350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:24.084024 run patchelf(pid=19264): Terminating (SIGINT) 12:17:24.254568 run patchelf(pid=19264): Terminated: ok {rc=0} 12:17:24.377409 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19261): Process ended prematurely: osmo-stp_10.42.42.5(pid=19261) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19261)] [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 12:17:24.387031 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:17:24.414787 run osmo-hlr_10.42.42.2(pid=19258): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19258)] 12:17:24.462640 run osmo-hlr_10.42.42.2(pid=19258): stdout: | (launched: 2022-12-13_12:17:21.229247) 12:17:24.512059 run osmo-hlr_10.42.42.2(pid=19258): stderr: | 20221213121721404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121721404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121721404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121721404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121721404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121721404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121721417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121721426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121721427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121721427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:24.562369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19247): Terminating (SIGTERM) 12:17:24.602360 run iperf3-srv_10.42.42.10(pid=19248): Terminating (SIGTERM) 12:17:24.641962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19249): Terminating (SIGTERM) 12:17:24.681580 run iperf3-srv_10.42.42.10(pid=19250): Terminating (SIGTERM) 12:17:24.721755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19251): Terminating (SIGTERM) 12:17:24.761539 run iperf3-srv_10.42.42.10(pid=19252): Terminating (SIGTERM) 12:17:24.800904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19253): Terminating (SIGTERM) 12:17:24.840557 run iperf3-srv_10.42.42.10(pid=19254): Terminating (SIGTERM) 12:17:24.879899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19257): Terminating (SIGTERM) 12:17:24.919343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19260): Terminating (SIGTERM) 12:17:24.958842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19263): Terminating (SIGTERM) 12:17:24.998696 --- ParallelTerminationStrategy: PID 19247 died... 12:17:25.017896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19247): Terminated: ok {rc=0} 12:17:25.062247 --- ParallelTerminationStrategy: PID 19248 died... 12:17:25.081094 run iperf3-srv_10.42.42.10(pid=19248): Terminated {rc=256} 12:17:25.124901 --- ParallelTerminationStrategy: PID 19249 died... 12:17:25.144034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19249): Terminated: ok {rc=0} 12:17:25.188056 --- ParallelTerminationStrategy: PID 19250 died... 12:17:25.206597 run iperf3-srv_10.42.42.10(pid=19250): Terminated {rc=256} 12:17:25.250337 --- ParallelTerminationStrategy: PID 19251 died... 12:17:25.269161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19251): Terminated: ok {rc=0} 12:17:25.312845 --- ParallelTerminationStrategy: PID 19252 died... 12:17:25.331846 run iperf3-srv_10.42.42.10(pid=19252): Terminated {rc=256} 12:17:25.375304 --- ParallelTerminationStrategy: PID 19253 died... 12:17:25.394082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19253): Terminated: ok {rc=0} 12:17:25.437791 --- ParallelTerminationStrategy: PID 19254 died... 12:17:25.456071 run iperf3-srv_10.42.42.10(pid=19254): Terminated {rc=256} 12:17:25.499921 --- ParallelTerminationStrategy: PID 19257 died... 12:17:25.518839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19257): Terminated: ok {rc=0} 12:17:25.562989 --- ParallelTerminationStrategy: PID 19260 died... 12:17:25.581971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19260): Terminated: ok {rc=0} 12:17:25.626192 --- ParallelTerminationStrategy: PID 19263 died... 12:17:25.645121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19263): Terminated: ok {rc=0} 12:17:25.730716 bus /gobi_4: Setting Powered False 12:17:26.832749 bus /gobi_4: Setting Powered False 12:17:27.948722 bus /gobi_1: Setting Powered False 12:17:29.046776 bus /gobi_1: Setting Powered False 12:17:30.162903 bus /gobi_0: Setting Powered False 12:17:31.271842 bus /gobi_0: Setting Powered False 12:17:32.408692 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 12:17:33.513850 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:33.526708 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:17:33.582020 tst ping.py: using LAC 33886 12:17:33.708831 tst ping.py: using RAC 226 12:17:33.835930 tst ping.py: using CellId 33886 12:17:33.965151 tst ping.py: using BVCI 33887 12:17:34.082926 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:34.094840 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:34.106539 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:34.118234 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:34.130249 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:34.142195 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:34.154287 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:34.166215 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:17:34.283894 tst ping.py:19: start network... 12:17:34.486044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:34.951357 run create_hlr_db(pid=19265): Launched 12:17:35.074683 bus /gobi_6: Setting Powered False 12:17:36.135025 run create_hlr_db(pid=19265): Terminated: ok {rc=0} 12:17:36.574770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19267): Launched 12:17:36.897392 run osmo-hlr_10.42.42.2(pid=19268): Launched 12:17:37.021789 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:37.581569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19270): Launched 12:17:37.906255 run osmo-stp_10.42.42.5(pid=19271): Launched 12:17:38.029175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:38.584300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19273): Launched 12:17:38.707666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:38.980533 run patchelf(pid=19274): Launched 12:17:39.161494 run osmo-stp_10.42.42.5(pid=19271): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19271)] 12:17:39.299090 run osmo-stp_10.42.42.5(pid=19271): stdout: | (launched: 2022-12-13_12:17:37.846992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:39.438003 run osmo-stp_10.42.42.5(pid=19271): stderr: | 20221213121738036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121738036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121738036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121738037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121738037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121738037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121738038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:39.576694 run osmo-stp_10.42.42.5(pid=19271): stdout: | (launched: 2022-12-13_12:17:37.846992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:39.709147 run osmo-stp_10.42.42.5(pid=19271): stderr: | 20221213121738036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121738036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121738036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121738037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121738037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121738037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121738038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:39.866684 run patchelf(pid=19274): Terminating (SIGINT) 12:17:40.047090 run patchelf(pid=19274): Terminated: ok {rc=0} 12:17:40.177210 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19271): Process ended prematurely: osmo-stp_10.42.42.5(pid=19271) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19271)] [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 12:17:40.187053 tst ping.py:22: Test FAILED (6.7 sec) 12:17:40.215484 run osmo-hlr_10.42.42.2(pid=19268): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19268)] 12:17:40.266608 run osmo-hlr_10.42.42.2(pid=19268): stdout: | (launched: 2022-12-13_12:17:36.838673) 12:17:40.319443 run osmo-hlr_10.42.42.2(pid=19268): stderr: | 20221213121737031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121737032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121737032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121737032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121737032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121737032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121737044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121737054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121737054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121737054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:40.372618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19267): Terminating (SIGTERM) 12:17:40.414492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19270): Terminating (SIGTERM) 12:17:40.457479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19273): Terminating (SIGTERM) 12:17:40.499935 --- ParallelTerminationStrategy: PID 19267 died... 12:17:40.520428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19267): Terminated: ok {rc=0} 12:17:40.567122 --- ParallelTerminationStrategy: PID 19270 died... 12:17:40.587122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19270): Terminated: ok {rc=0} 12:17:40.634145 --- ParallelTerminationStrategy: PID 19273 died... 12:17:40.654333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19273): Terminated: ok {rc=0} 12:17:40.743954 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 12:17:41.832224 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:41.844832 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:17:41.900599 tst ping_idle_ping.py: using LAC 33887 12:17:42.027738 tst ping_idle_ping.py: using RAC 227 12:17:42.153364 tst ping_idle_ping.py: using CellId 33887 12:17:42.279354 tst ping_idle_ping.py: using BVCI 33888 12:17:42.396655 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:42.408595 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:42.420317 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:42.432082 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:42.444001 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:42.456082 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:42.468123 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:17:42.480100 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:17:42.600685 tst ping_idle_ping.py:24: start network... 12:17:42.819773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:43.321137 run create_hlr_db(pid=19275): Launched 12:17:43.445331 bus /gobi_6: Setting Powered False 12:17:44.505480 run create_hlr_db(pid=19275): Terminated: ok {rc=0} 12:17:44.956256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19277): Launched 12:17:45.281264 run osmo-hlr_10.42.42.2(pid=19278): Launched 12:17:45.405733 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:45.980627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19280): Launched 12:17:46.318649 run osmo-stp_10.42.42.5(pid=19281): Launched 12:17:46.543340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:47.167372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19283): Launched 12:17:47.302347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:47.558349 run patchelf(pid=19284): Launched 12:17:47.727982 run osmo-stp_10.42.42.5(pid=19281): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19281)] 12:17:47.856432 run osmo-stp_10.42.42.5(pid=19281): stdout: | (launched: 2022-12-13_12:17:46.259485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:47.986317 run osmo-stp_10.42.42.5(pid=19281): stderr: | 20221213121746548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121746561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121746561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121746562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121746562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121746562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121746562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:48.116012 run osmo-stp_10.42.42.5(pid=19281): stdout: | (launched: 2022-12-13_12:17:46.259485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:48.239481 run osmo-stp_10.42.42.5(pid=19281): stderr: | 20221213121746548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121746561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121746561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121746562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121746562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121746562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121746562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:48.385858 run patchelf(pid=19284): Terminating (SIGINT) 12:17:48.554332 run patchelf(pid=19284): Terminated: ok {rc=0} 12:17:48.676085 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19281): Process ended prematurely: osmo-stp_10.42.42.5(pid=19281) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19281)] [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 12:17:48.685422 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:17:48.712432 run osmo-hlr_10.42.42.2(pid=19278): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19278)] 12:17:48.760614 run osmo-hlr_10.42.42.2(pid=19278): stdout: | (launched: 2022-12-13_12:17:45.222061) 12:17:48.810479 run osmo-hlr_10.42.42.2(pid=19278): stderr: | 20221213121745417 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121745417 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121745417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121745417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121745417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121745417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121745431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121745441 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121745441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121745441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:48.860896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19277): Terminating (SIGTERM) 12:17:48.901354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19280): Terminating (SIGTERM) 12:17:48.941601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19283): Terminating (SIGTERM) 12:17:48.982203 --- ParallelTerminationStrategy: PID 19277 died... 12:17:49.001760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19277): Terminated: ok {rc=0} 12:17:49.046591 --- ParallelTerminationStrategy: PID 19280 died... 12:17:49.065664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19280): Terminated: ok {rc=0} 12:17:49.110036 --- ParallelTerminationStrategy: PID 19283 died... 12:17:49.129271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19283): Terminated: ok {rc=0} 12:17:49.216115 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:17:50.527880 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:17:50.535078 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:17:50.567921 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:17:50.603092 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:17:50.655836 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:17:50.688510 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:17:50.723162 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:17:51.294393 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:17:51.300144 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:17:51.312063 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:17:51.387161 tst switch_tch_pdch.py: using LAC 33888 12:17:51.514030 tst switch_tch_pdch.py: using RAC 228 12:17:51.640156 tst switch_tch_pdch.py: using CellId 33888 12:17:51.766201 tst switch_tch_pdch.py: using BVCI 33889 12:17:51.885689 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:17:51.897597 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:17:51.909123 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:17:51.920827 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:17:51.933470 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:17:51.945893 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:17:51.958488 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:17:51.971077 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:17:52.090388 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:17:52.206316 tst switch_tch_pdch.py:51: start network... 12:17:52.407793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:52.872470 run create_hlr_db(pid=19288): Launched 12:17:52.996333 bus /gobi_6: Setting Powered False 12:17:54.060433 run create_hlr_db(pid=19288): Terminated: ok {rc=0} 12:17:54.511116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19290): Launched 12:17:54.834185 run osmo-hlr_10.42.42.2(pid=19291): Launched 12:17:54.958169 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:55.513217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19293): Launched 12:17:55.834388 run osmo-stp_10.42.42.5(pid=19294): Launched 12:17:55.958491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:56.512745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19296): Launched 12:17:56.635675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:56.907319 run patchelf(pid=19297): Launched 12:17:57.086522 run osmo-stp_10.42.42.5(pid=19294): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19294)] 12:17:57.223421 run osmo-stp_10.42.42.5(pid=19294): stdout: | (launched: 2022-12-13_12:17:55.775309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:57.362124 run osmo-stp_10.42.42.5(pid=19294): stderr: | 20221213121755964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121755964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121755964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121755965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121755965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121755965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121755966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:57.500464 run osmo-stp_10.42.42.5(pid=19294): stdout: | (launched: 2022-12-13_12:17:55.775309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:57.632169 run osmo-stp_10.42.42.5(pid=19294): stderr: | 20221213121755964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121755964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121755964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121755965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121755965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121755965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121755966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:57.788610 run patchelf(pid=19297): Terminating (SIGINT) 12:17:57.968304 run patchelf(pid=19297): Terminated: ok {rc=0} 12:17:58.098270 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19294): Process ended prematurely: osmo-stp_10.42.42.5(pid=19294) [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19294)] [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:17:58.108268 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 12:17:58.137158 run osmo-hlr_10.42.42.2(pid=19291): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19291)] 12:17:58.188480 run osmo-hlr_10.42.42.2(pid=19291): stdout: | (launched: 2022-12-13_12:17:54.774835) 12:17:58.241519 run osmo-hlr_10.42.42.2(pid=19291): stderr: | 20221213121754970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121754970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121754970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121754970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121754970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121754970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121754983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121754991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121754991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121754991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:58.294825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19290): Terminating (SIGTERM) 12:17:58.337430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19293): Terminating (SIGTERM) 12:17:58.380154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19296): Terminating (SIGTERM) 12:17:58.423373 --- ParallelTerminationStrategy: PID 19290 died... 12:17:58.444238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19290): Terminated: ok {rc=0} 12:17:58.491268 --- ParallelTerminationStrategy: PID 19293 died... 12:17:58.511456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19293): Terminated: ok {rc=0} 12:17:58.558479 --- ParallelTerminationStrategy: PID 19296 died... 12:17:58.578621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19296): Terminated: ok {rc=0} 12:17:58.668484 bus /gobi_0: Setting Powered False 12:17:59.769051 bus /gobi_0: Setting Powered False 12:18:00.906663 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:18:02.182843 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:02.194228 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:18:02.231763 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:18:02.269810 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:18:02.322583 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:18:02.355178 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:18:02.389339 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:18:02.950733 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:18:02.957204 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:02.969096 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:18:03.040251 tst switch_tch_pdch.py: using LAC 33889 12:18:03.164495 tst switch_tch_pdch.py: using RAC 229 12:18:03.288527 tst switch_tch_pdch.py: using CellId 33889 12:18:03.413237 tst switch_tch_pdch.py: using BVCI 33890 12:18:03.529642 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:03.541223 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:03.552543 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:03.563937 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:03.575544 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:03.587330 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:03.599185 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:03.610856 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:18:03.729444 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:18:03.845514 tst switch_tch_pdch.py:51: start network... 12:18:04.047083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:04.485517 run create_hlr_db(pid=19301): Launched 12:18:04.614697 bus /gobi_6: Setting Powered False 12:18:05.677777 run create_hlr_db(pid=19301): Terminated: ok {rc=0} 12:18:06.098266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19303): Launched 12:18:06.421409 run osmo-hlr_10.42.42.2(pid=19304): Launched 12:18:06.537807 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:07.040790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19306): Launched 12:18:07.341713 run osmo-stp_10.42.42.5(pid=19307): Launched 12:18:07.459835 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:07.953151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19309): Launched 12:18:08.068116 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:08.322732 run patchelf(pid=19310): Launched 12:18:08.489981 run osmo-stp_10.42.42.5(pid=19307): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19307)] 12:18:08.617405 run osmo-stp_10.42.42.5(pid=19307): stdout: | (launched: 2022-12-13_12:18:07.286376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:08.746117 run osmo-stp_10.42.42.5(pid=19307): stderr: | 20221213121807453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121807453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121807453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121807453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121807454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121807454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121807454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:08.875381 run osmo-stp_10.42.42.5(pid=19307): stdout: | (launched: 2022-12-13_12:18:07.286376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:08.998581 run osmo-stp_10.42.42.5(pid=19307): stderr: | 20221213121807453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121807453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121807453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121807453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121807454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121807454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121807454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:09.143814 run patchelf(pid=19310): Terminating (SIGINT) 12:18:09.311339 run patchelf(pid=19310): Terminated: ok {rc=0} 12:18:09.432776 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19307): Process ended prematurely: osmo-stp_10.42.42.5(pid=19307) [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19307)] [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:18:09.442084 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 12:18:09.468897 run osmo-hlr_10.42.42.2(pid=19304): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19304)] 12:18:09.517170 run osmo-hlr_10.42.42.2(pid=19304): stdout: | (launched: 2022-12-13_12:18:06.362598) 12:18:09.567361 run osmo-hlr_10.42.42.2(pid=19304): stderr: | 20221213121806542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121806542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121806542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121806543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121806543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121806543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121806555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121806564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121806564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121806564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:09.618057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19303): Terminating (SIGTERM) 12:18:09.658606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19306): Terminating (SIGTERM) 12:18:09.698841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19309): Terminating (SIGTERM) 12:18:09.739354 --- ParallelTerminationStrategy: PID 19303 died... 12:18:09.758853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19303): Terminated: ok {rc=0} 12:18:09.803243 --- ParallelTerminationStrategy: PID 19306 died... 12:18:09.822016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19306): Terminated: ok {rc=0} 12:18:09.866035 --- ParallelTerminationStrategy: PID 19309 died... 12:18:09.884801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19309): Terminated: ok {rc=0} 12:18:09.971347 bus /gobi_0: Setting Powered False 12:18:11.072074 bus /gobi_0: Setting Powered False 12:18:12.187813 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_sms:trx-lms --------------------------------------------------------------------- 12:18:13.444883 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:13.449288 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 12:18:13.483337 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 12:18:13.491594 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 12:18:13.545276 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 12:18:13.579382 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 12:18:13.586380 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 12:18:14.125424 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 12:18:14.130868 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 12:18:14.142358 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 12:18:14.194968 tst mo_mt_sms.py: using LAC 33890 12:18:14.322040 tst mo_mt_sms.py: using RAC 230 12:18:14.450582 tst mo_mt_sms.py: using CellId 33890 12:18:14.577584 tst mo_mt_sms.py: using BVCI 33891 12:18:14.695913 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 12:18:14.811490 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 12:18:14.924606 tst mo_mt_sms.py:9: start nitb and bts... 12:18:15.143270 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:18:15.797937 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19314): Launched 12:18:16.125763 run osmo-nitb_10.42.42.2(pid=19315): Launched 12:18:16.321389 run osmo-nitb_10.42.42.2(pid=19315): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19315)] 12:18:16.465459 run osmo-nitb_10.42.42.2(pid=19315): stdout: | (launched: 2022-12-13_12:18:16.066617) 12:18:16.607560 run osmo-nitb_10.42.42.2(pid=19315): stderr: | (launched: 2022-12-13_12:18:16.115017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:18:16.748461 run osmo-nitb_10.42.42.2(pid=19315): stdout: | (launched: 2022-12-13_12:18:16.066617) 12:18:16.882538 run osmo-nitb_10.42.42.2(pid=19315): stderr: | (launched: 2022-12-13_12:18:16.115017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19315): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19315) [trial-2389↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19315)] 12:18:17.263854 tst osmo-nitb_10.42.42.2(pid=19315): stdout: | (launched: 2022-12-13_12:18:16.066617) 12:18:17.387403 tst osmo-nitb_10.42.42.2(pid=19315): stderr: | (launched: 2022-12-13_12:18:16.115017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:18:17.533674 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19315): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19315) [trial-2389↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19315)] [trial-2389↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 12:18:17.542380 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 12:18:17.549377 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19314): Terminating (SIGTERM) 12:18:17.759077 --- ParallelTerminationStrategy: PID 19314 died... 12:18:17.780124 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19314): Terminated: ok {rc=0} 12:18:17.868337 bus /sierra_3: Setting Powered False 12:18:18.971495 bus /sierra_3: Setting Powered False 12:18:20.089068 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 sms:trx-lms --------------------------------------------------------------------- 12:18:21.295611 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:21.300510 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 12:18:21.335636 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:18:21.364290 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 12:18:21.418481 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 12:18:21.452400 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:18:21.480285 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 12:18:22.026033 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 12:18:22.032021 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:22.043300 tst sms:trx-lms: Using 1 x bts (candidates: 1) 12:18:22.091825 tst mo_mt_sms.py: using LAC 33891 12:18:22.219918 tst mo_mt_sms.py: using RAC 231 12:18:22.346082 tst mo_mt_sms.py: using CellId 33891 12:18:22.471354 tst mo_mt_sms.py: using BVCI 33892 12:18:22.588069 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:22.599327 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:22.610341 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:22.621253 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:22.632424 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:22.643718 tst sms:trx-lms: Using 1 x modem (candidates: 2) 12:18:22.759730 tst sms:trx-lms: Using 1 x modem (candidates: 2) 12:18:22.882784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:23.378666 run create_hlr_db(pid=19319): Launched 12:18:23.503330 bus /sierra_2: Setting Powered False 12:18:24.566521 run create_hlr_db(pid=19319): Terminated: ok {rc=0} 12:18:24.996017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19321): Launched 12:18:25.297649 run osmo-hlr_10.42.42.2(pid=19322): Launched 12:18:25.415905 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:25.936714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19324): Launched 12:18:26.236618 run osmo-stp_10.42.42.5(pid=19325): Launched 12:18:26.350708 run osmo-msc_10.42.42.6: Starting osmo-msc 12:18:26.892100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19327): Launched 12:18:27.192210 run osmo-msc_10.42.42.6(pid=19328): Launched 12:18:27.360126 run osmo-stp_10.42.42.5(pid=19325): ERR: Terminated: ERROR {rc=1} [trial-2389↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19325)] 12:18:27.486877 run osmo-stp_10.42.42.5(pid=19325): stdout: | (launched: 2022-12-13_12:18:26.181469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:27.614358 run osmo-stp_10.42.42.5(pid=19325): stderr: | 20221213121826350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121826350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121826350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121826351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121826351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121826351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121826351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:27.738815 run osmo-stp_10.42.42.5(pid=19325): stdout: | (launched: 2022-12-13_12:18:26.181469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:27.858230 run osmo-stp_10.42.42.5(pid=19325): stderr: | 20221213121826350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121826350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121826350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121826351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121826351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121826351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121826351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:28.000755 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19325): Process ended prematurely: osmo-stp_10.42.42.5(pid=19325) [trial-2389↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19325)] [trial-2389↪sms:trx-lms↪mo_mt_sms.py:16] 12:18:28.009236 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 12:18:28.035078 run osmo-hlr_10.42.42.2(pid=19322): ERR: Terminated: ERROR {rc=237} [trial-2389↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19322)] 12:18:28.082262 run osmo-hlr_10.42.42.2(pid=19322): stdout: | (launched: 2022-12-13_12:18:25.242124) 12:18:28.131256 run osmo-hlr_10.42.42.2(pid=19322): stderr: | 20221213121825414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121825415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121825415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121825415 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121825415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121825415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121825427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121825435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121825435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121825435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:28.200364 run osmo-msc_10.42.42.6(pid=19328): ERR: Terminated: ERROR {rc=2} [trial-2389↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19328)] 12:18:28.247637 run osmo-msc_10.42.42.6(pid=19328): stdout: | (launched: 2022-12-13_12:18:27.137092) 12:18:28.296641 run osmo-msc_10.42.42.6(pid=19328): stderr: | 20221213121827406 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121827406 DLGLOBAL DEBUG validating counter group 0x7fa5efca9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121827406 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121827406 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121827406 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121827406 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121827408 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121827408 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121827409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121827409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:18:28.346381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19321): Terminating (SIGTERM) 12:18:28.386068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19324): Terminating (SIGTERM) 12:18:28.425661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19327): Terminating (SIGTERM) 12:18:28.465547 --- ParallelTerminationStrategy: PID 19321 died... 12:18:28.484458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19321): Terminated: ok {rc=0} 12:18:28.528426 --- ParallelTerminationStrategy: PID 19324 died... 12:18:28.546998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19324): Terminated: ok {rc=0} 12:18:28.590583 --- ParallelTerminationStrategy: PID 19327 died... 12:18:28.609145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19327): Terminated: ok {rc=0} 12:18:28.694832 bus /sierra_3: Setting Powered False 12:18:29.792930 bus /sierra_3: Setting Powered False 12:18:30.922864 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-lms --------------------------------------------------------------------- 12:18:32.174648 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:32.180378 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 12:18:32.223911 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 12:18:32.231962 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 12:18:32.267801 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 12:18:32.304058 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 12:18:32.313380 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 12:18:32.831236 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 12:18:32.837342 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 12:18:32.848117 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 12:18:32.906060 tst assert_extension.py: using LAC 33892 12:18:33.031421 tst assert_extension.py: using RAC 232 12:18:33.152489 tst assert_extension.py: using CellId 33892 12:18:33.273874 tst assert_extension.py: using BVCI 33893 12:18:33.383919 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 12:18:33.503407 tst assert_extension.py:10: start nitb and bts... 12:18:33.722567 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:18:34.378850 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19333): Launched 12:18:34.701078 run osmo-nitb_10.42.42.2(pid=19334): Launched 12:18:34.868572 run osmo-nitb_10.42.42.2(pid=19334): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19334)] 12:18:35.003198 run osmo-nitb_10.42.42.2(pid=19334): stdout: | (launched: 2022-12-13_12:18:34.642482) 12:18:35.139504 run osmo-nitb_10.42.42.2(pid=19334): stderr: | (launched: 2022-12-13_12:18:34.690157) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:18:35.275728 run osmo-nitb_10.42.42.2(pid=19334): stdout: | (launched: 2022-12-13_12:18:34.642482) 12:18:35.406111 run osmo-nitb_10.42.42.2(pid=19334): stderr: | (launched: 2022-12-13_12:18:34.690157) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19334): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19334) [trial-2389↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19334)] 12:18:35.815168 tst osmo-nitb_10.42.42.2(pid=19334): stdout: | (launched: 2022-12-13_12:18:34.642482) 12:18:35.936843 tst osmo-nitb_10.42.42.2(pid=19334): stderr: | (launched: 2022-12-13_12:18:34.690157) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:18:36.080525 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19334): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19334) [trial-2389↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19334)] [trial-2389↪nitb_ussd:trx-lms↪assert_extension.py:12] 12:18:36.089383 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:18:36.096176 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19333): Terminating (SIGTERM) 12:18:36.304922 --- ParallelTerminationStrategy: PID 19333 died... 12:18:36.325682 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19333): Terminated: ok {rc=0} 12:18:36.410112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 ussd:trx-lms --------------------------------------------------------------------- 12:18:37.588881 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:37.593249 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 12:18:37.627238 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:18:37.655692 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 12:18:37.693074 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 12:18:37.727239 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:18:37.755033 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 12:18:38.284134 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 ussd:trx-lms assert_extension.py ---------------------------------------------- 12:18:38.289759 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:38.300805 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 12:18:38.353418 tst assert_extension.py: using LAC 33893 12:18:38.480315 tst assert_extension.py: using RAC 233 12:18:38.599388 tst assert_extension.py: using CellId 33893 12:18:38.716569 tst assert_extension.py: using BVCI 33894 12:18:38.824413 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:38.835322 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:38.845822 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:38.856143 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:38.866637 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:18:38.877616 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 12:18:38.996575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:39.494584 run create_hlr_db(pid=19338): Launched 12:18:39.619816 bus /sierra_2: Setting Powered False 12:18:40.683035 run create_hlr_db(pid=19338): Terminated: ok {rc=0} 12:18:41.116162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19340): Launched 12:18:41.439803 run osmo-hlr_10.42.42.2(pid=19341): Launched 12:18:41.563740 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:42.126106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19343): Launched 12:18:42.450340 run osmo-stp_10.42.42.5(pid=19344): Launched 12:18:42.573234 run osmo-msc_10.42.42.6: Starting osmo-msc 12:18:43.153322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19346): Launched 12:18:43.475246 run osmo-msc_10.42.42.6(pid=19347): Launched 12:18:43.656049 run osmo-stp_10.42.42.5(pid=19344): ERR: Terminated: ERROR {rc=1} [trial-2389↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19344)] 12:18:43.791625 run osmo-stp_10.42.42.5(pid=19344): stdout: | (launched: 2022-12-13_12:18:42.391525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:43.928438 run osmo-stp_10.42.42.5(pid=19344): stderr: | 20221213121842580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121842580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121842580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121842581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121842581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121842581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121842581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:44.063911 run osmo-stp_10.42.42.5(pid=19344): stdout: | (launched: 2022-12-13_12:18:42.391525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:44.192362 run osmo-stp_10.42.42.5(pid=19344): stderr: | 20221213121842580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121842580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121842580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121842581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121842581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121842581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121842581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:44.346054 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19344): Process ended prematurely: osmo-stp_10.42.42.5(pid=19344) [trial-2389↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19344)] [trial-2389↪ussd:trx-lms↪assert_extension.py:17] 12:18:44.355368 tst assert_extension.py:17: Test FAILED (6.1 sec) 12:18:44.383042 run osmo-hlr_10.42.42.2(pid=19341): ERR: Terminated: ERROR {rc=237} [trial-2389↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19341)] 12:18:44.434237 run osmo-hlr_10.42.42.2(pid=19341): stdout: | (launched: 2022-12-13_12:18:41.381161) 12:18:44.486727 run osmo-hlr_10.42.42.2(pid=19341): stderr: | 20221213121841576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121841576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121841576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121841576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121841576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121841576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121841588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121841596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121841597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121841597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:44.560197 run osmo-msc_10.42.42.6(pid=19347): ERR: Terminated: ERROR {rc=2} [trial-2389↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19347)] 12:18:44.610542 run osmo-msc_10.42.42.6(pid=19347): stdout: | (launched: 2022-12-13_12:18:43.416371) 12:18:44.663093 run osmo-msc_10.42.42.6(pid=19347): stderr: | 20221213121843735 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121843735 DLGLOBAL DEBUG validating counter group 0x7f94f709bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121843735 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121843735 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121843735 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121843736 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121843737 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121843738 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121843738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121843738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:18:44.716220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19340): Terminating (SIGTERM) 12:18:44.758611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19343): Terminating (SIGTERM) 12:18:44.801668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19346): Terminating (SIGTERM) 12:18:44.845104 --- ParallelTerminationStrategy: PID 19340 died... 12:18:44.865919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19340): Terminated: ok {rc=0} 12:18:44.913492 --- ParallelTerminationStrategy: PID 19343 died... 12:18:44.933804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19343): Terminated: ok {rc=0} 12:18:44.980938 --- ParallelTerminationStrategy: PID 19346 died... 12:18:45.001523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19346): Terminated: ok {rc=0} 12:18:45.090612 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:18:46.310018 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:46.317631 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:18:46.353955 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:18:46.383295 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:18:46.439470 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:18:46.490101 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:18:46.527363 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:18:47.050424 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:18:47.110267 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:47.122324 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:18:47.192066 tst mo_mt_call.py: using LAC 33894 12:18:47.313830 tst mo_mt_call.py: using RAC 234 12:18:47.440721 tst mo_mt_call.py: using CellId 33894 12:18:47.559797 tst mo_mt_call.py: using BVCI 33895 12:18:47.670686 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:47.681821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:47.692691 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:47.703656 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:47.714650 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:47.726019 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:18:47.848379 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:18:47.969860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:48.477241 run create_hlr_db(pid=19352): Launched 12:18:48.604252 bus /sierra_2: Setting Powered False 12:18:49.669662 run create_hlr_db(pid=19352): Terminated: ok {rc=0} 12:18:50.107837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19354): Launched 12:18:50.414509 run osmo-hlr_10.42.42.2(pid=19355): Launched 12:18:50.531139 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:51.073415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19357): Launched 12:18:51.380856 run osmo-stp_10.42.42.5(pid=19358): Launched 12:18:51.496261 run osmo-msc_10.42.42.6: Starting osmo-msc 12:18:52.049080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19360): Launched 12:18:52.354978 run osmo-msc_10.42.42.6(pid=19361): Launched 12:18:52.525366 run osmo-stp_10.42.42.5(pid=19358): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19358)] 12:18:52.654308 run osmo-stp_10.42.42.5(pid=19358): stdout: | (launched: 2022-12-13_12:18:51.324416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:52.782935 run osmo-stp_10.42.42.5(pid=19358): stderr: | 20221213121851495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121851496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121851496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121851496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121851497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121851497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121851497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:52.909885 run osmo-stp_10.42.42.5(pid=19358): stdout: | (launched: 2022-12-13_12:18:51.324416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:53.031209 run osmo-stp_10.42.42.5(pid=19358): stderr: | 20221213121851495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121851496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121851496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121851496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121851497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121851497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121851497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:53.176091 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19358): Process ended prematurely: osmo-stp_10.42.42.5(pid=19358) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19358)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:18:53.185394 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:18:53.212171 run osmo-hlr_10.42.42.2(pid=19355): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19355)] 12:18:53.259899 run osmo-hlr_10.42.42.2(pid=19355): stdout: | (launched: 2022-12-13_12:18:50.358431) 12:18:53.309338 run osmo-hlr_10.42.42.2(pid=19355): stderr: | 20221213121850535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121850535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121850535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121850535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121850536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121850536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121850548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121850557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121850557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121850557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:53.378892 run osmo-msc_10.42.42.6(pid=19361): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19361)] 12:18:53.426492 run osmo-msc_10.42.42.6(pid=19361): stdout: | (launched: 2022-12-13_12:18:52.298762) 12:18:53.475844 run osmo-msc_10.42.42.6(pid=19361): stderr: | 20221213121852570 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121852570 DLGLOBAL DEBUG validating counter group 0x7feff2b6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121852570 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121852570 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121852570 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121852570 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121852572 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121852572 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121852573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121852573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:18:53.525569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19354): Terminating (SIGTERM) 12:18:53.565431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19357): Terminating (SIGTERM) 12:18:53.605435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19360): Terminating (SIGTERM) 12:18:53.645584 --- ParallelTerminationStrategy: PID 19354 died... 12:18:53.664993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19354): Terminated: ok {rc=0} 12:18:53.709275 --- ParallelTerminationStrategy: PID 19357 died... 12:18:53.728011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19357): Terminated: ok {rc=0} 12:18:53.772550 --- ParallelTerminationStrategy: PID 19360 died... 12:18:53.791644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19360): Terminated: ok {rc=0} 12:18:53.879227 bus /sierra_3: Setting Powered False 12:18:54.980559 bus /sierra_3: Setting Powered False 12:18:56.098566 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:18:57.245974 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:57.257876 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:18:57.327709 tst mo_mt_call_osmux.py: using LAC 33895 12:18:57.448415 tst mo_mt_call_osmux.py: using RAC 235 12:18:57.566686 tst mo_mt_call_osmux.py: using CellId 33895 12:18:57.686520 tst mo_mt_call_osmux.py: using BVCI 33896 12:18:57.798512 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:57.810136 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:57.821215 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:57.832256 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:57.843346 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:18:57.854286 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:18:57.975677 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:18:58.097466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:58.573184 run create_hlr_db(pid=19363): Launched 12:18:58.699255 bus /sierra_2: Setting Powered False 12:18:59.760600 run create_hlr_db(pid=19363): Terminated: ok {rc=0} 12:19:00.189564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19365): Launched 12:19:00.498237 run osmo-hlr_10.42.42.2(pid=19366): Launched 12:19:00.614398 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:01.171959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19368): Launched 12:19:01.501746 run osmo-stp_10.42.42.5(pid=19369): Launched 12:19:01.789686 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:02.410015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19371): Launched 12:19:02.740592 run osmo-msc_10.42.42.6(pid=19372): Launched 12:19:02.923418 run osmo-stp_10.42.42.5(pid=19369): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19369)] 12:19:03.061177 run osmo-stp_10.42.42.5(pid=19369): stdout: | (launched: 2022-12-13_12:19:01.439762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:03.199599 run osmo-stp_10.42.42.5(pid=19369): stderr: | 20221213121901657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121901657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121901658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121901658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121901659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121901659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121901659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:03.336557 run osmo-stp_10.42.42.5(pid=19369): stdout: | (launched: 2022-12-13_12:19:01.439762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:03.466986 run osmo-stp_10.42.42.5(pid=19369): stderr: | 20221213121901657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121901657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121901658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121901658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121901659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121901659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121901659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:03.622846 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19369): Process ended prematurely: osmo-stp_10.42.42.5(pid=19369) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19369)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:19:03.632785 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:19:03.661223 run osmo-hlr_10.42.42.2(pid=19366): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19366)] 12:19:03.713434 run osmo-hlr_10.42.42.2(pid=19366): stdout: | (launched: 2022-12-13_12:19:00.441727) 12:19:03.766631 run osmo-hlr_10.42.42.2(pid=19366): stderr: | 20221213121900616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121900616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121900616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121900616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121900616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121900616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121900629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121900637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121900638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121900638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:03.840935 run osmo-msc_10.42.42.6(pid=19372): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19372)] 12:19:03.892618 run osmo-msc_10.42.42.6(pid=19372): stdout: | (launched: 2022-12-13_12:19:02.680918) 12:19:03.945672 run osmo-msc_10.42.42.6(pid=19372): stderr: | 20221213121902999 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121903000 DLGLOBAL DEBUG validating counter group 0x7fca32c7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121903000 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121903000 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121903000 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121903000 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121903002 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121903002 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121903002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121903002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:03.998938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19365): Terminating (SIGTERM) 12:19:04.041329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19368): Terminating (SIGTERM) 12:19:04.084354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19371): Terminating (SIGTERM) 12:19:04.127656 --- ParallelTerminationStrategy: PID 19365 died... 12:19:04.148575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19365): Terminated: ok {rc=0} 12:19:04.196072 --- ParallelTerminationStrategy: PID 19368 died... 12:19:04.216495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19368): Terminated: ok {rc=0} 12:19:04.263670 --- ParallelTerminationStrategy: PID 19371 died... 12:19:04.284096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19371): Terminated: ok {rc=0} 12:19:04.374701 bus /sierra_3: Setting Powered False 12:19:05.471618 bus /sierra_3: Setting Powered False 12:19:06.588265 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:19:07.842959 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:07.849451 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:19:07.882860 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:19:07.909864 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:19:07.963578 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:19:07.997945 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:19:08.025474 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:19:08.572748 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:19:08.622816 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:08.634033 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:19:08.705141 tst mo_mt_call.py: using LAC 33896 12:19:08.827598 tst mo_mt_call.py: using RAC 236 12:19:08.949383 tst mo_mt_call.py: using CellId 33896 12:19:09.073696 tst mo_mt_call.py: using BVCI 33897 12:19:09.185614 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:09.196667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:09.207711 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:09.218627 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:09.229624 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:09.240497 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:09.356869 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:09.475791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:09.986035 run create_hlr_db(pid=19378): Launched 12:19:10.114387 bus /sierra_2: Setting Powered False 12:19:11.179065 run create_hlr_db(pid=19378): Terminated: ok {rc=0} 12:19:11.635952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19380): Launched 12:19:11.965701 run osmo-hlr_10.42.42.2(pid=19381): Launched 12:19:12.092000 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:12.656669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19383): Launched 12:19:12.984501 run osmo-stp_10.42.42.5(pid=19384): Launched 12:19:13.111075 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:13.701902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19386): Launched 12:19:14.031637 run osmo-msc_10.42.42.6(pid=19387): Launched 12:19:14.214611 run osmo-stp_10.42.42.5(pid=19384): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19384)] 12:19:14.352721 run osmo-stp_10.42.42.5(pid=19384): stdout: | (launched: 2022-12-13_12:19:12.924831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:14.491623 run osmo-stp_10.42.42.5(pid=19384): stderr: | 20221213121913113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121913114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121913114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121913114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121913115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121913115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121913115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:14.628521 run osmo-stp_10.42.42.5(pid=19384): stdout: | (launched: 2022-12-13_12:19:12.924831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:14.758851 run osmo-stp_10.42.42.5(pid=19384): stderr: | 20221213121913113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121913114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121913114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121913114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121913115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121913115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121913115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:14.915180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19384): Process ended prematurely: osmo-stp_10.42.42.5(pid=19384) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19384)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:19:14.925162 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:19:14.953344 run osmo-hlr_10.42.42.2(pid=19381): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19381)] 12:19:15.004254 run osmo-hlr_10.42.42.2(pid=19381): stdout: | (launched: 2022-12-13_12:19:11.905676) 12:19:15.056860 run osmo-hlr_10.42.42.2(pid=19381): stderr: | 20221213121912101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121912101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121912101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121912101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121912101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121912101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121912117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121912127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121912127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121912127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:15.129585 run osmo-msc_10.42.42.6(pid=19387): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19387)] 12:19:15.179687 run osmo-msc_10.42.42.6(pid=19387): stdout: | (launched: 2022-12-13_12:19:13.971549) 12:19:15.232110 run osmo-msc_10.42.42.6(pid=19387): stderr: | 20221213121914289 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121914289 DLGLOBAL DEBUG validating counter group 0x7fd39072dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121914289 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121914289 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121914290 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121914290 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121914291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121914292 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121914292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121914292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:15.285085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19380): Terminating (SIGTERM) 12:19:15.327042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19383): Terminating (SIGTERM) 12:19:15.369633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19386): Terminating (SIGTERM) 12:19:15.412047 --- ParallelTerminationStrategy: PID 19380 died... 12:19:15.432557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19380): Terminated: ok {rc=0} 12:19:15.479916 --- ParallelTerminationStrategy: PID 19383 died... 12:19:15.500169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19383): Terminated: ok {rc=0} 12:19:15.547234 --- ParallelTerminationStrategy: PID 19386 died... 12:19:15.567192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19386): Terminated: ok {rc=0} 12:19:15.657412 bus /sierra_3: Setting Powered False 12:19:16.754708 bus /sierra_3: Setting Powered False 12:19:17.869769 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:19:19.013633 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:19.025346 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:19:19.094510 tst mo_mt_call_osmux.py: using LAC 33897 12:19:19.214109 tst mo_mt_call_osmux.py: using RAC 237 12:19:19.331760 tst mo_mt_call_osmux.py: using CellId 33897 12:19:19.450469 tst mo_mt_call_osmux.py: using BVCI 33898 12:19:19.562192 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:19.573398 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:19.584326 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:19.595429 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:19.606582 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:19.617594 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:19.733101 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:19.852713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:20.327282 run create_hlr_db(pid=19389): Launched 12:19:20.453154 bus /sierra_2: Setting Powered False 12:19:21.514368 run create_hlr_db(pid=19389): Terminated: ok {rc=0} 12:19:21.941111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19391): Launched 12:19:22.248899 run osmo-hlr_10.42.42.2(pid=19392): Launched 12:19:22.365442 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:22.891782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19394): Launched 12:19:23.199162 run osmo-stp_10.42.42.5(pid=19395): Launched 12:19:23.315875 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:23.869050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19397): Launched 12:19:24.175594 run osmo-msc_10.42.42.6(pid=19398): Launched 12:19:24.346474 run osmo-stp_10.42.42.5(pid=19395): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19395)] 12:19:24.475802 run osmo-stp_10.42.42.5(pid=19395): stdout: | (launched: 2022-12-13_12:19:23.142974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:24.604928 run osmo-stp_10.42.42.5(pid=19395): stderr: | 20221213121923312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121923312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121923312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121923313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121923313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121923313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121923313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:24.731972 run osmo-stp_10.42.42.5(pid=19395): stdout: | (launched: 2022-12-13_12:19:23.142974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:24.853292 run osmo-stp_10.42.42.5(pid=19395): stderr: | 20221213121923312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121923312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121923312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121923313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121923313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121923313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121923313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:24.998711 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19395): Process ended prematurely: osmo-stp_10.42.42.5(pid=19395) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19395)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:19:25.007802 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:19:25.034531 run osmo-hlr_10.42.42.2(pid=19392): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19392)] 12:19:25.082609 run osmo-hlr_10.42.42.2(pid=19392): stdout: | (launched: 2022-12-13_12:19:22.192637) 12:19:25.132882 run osmo-hlr_10.42.42.2(pid=19392): stderr: | 20221213121922369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121922369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121922369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121922369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121922369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121922369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121922381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121922390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121922391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121922391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:25.203163 run osmo-msc_10.42.42.6(pid=19398): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19398)] 12:19:25.251511 run osmo-msc_10.42.42.6(pid=19398): stdout: | (launched: 2022-12-13_12:19:24.119196) 12:19:25.301660 run osmo-msc_10.42.42.6(pid=19398): stderr: | 20221213121924389 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121924389 DLGLOBAL DEBUG validating counter group 0x7f63f0bc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121924389 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121924389 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121924389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121924389 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121924391 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121924391 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121924392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121924392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:25.351976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19391): Terminating (SIGTERM) 12:19:25.392141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19394): Terminating (SIGTERM) 12:19:25.432466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19397): Terminating (SIGTERM) 12:19:25.473156 --- ParallelTerminationStrategy: PID 19391 died... 12:19:25.492678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19391): Terminated: ok {rc=0} 12:19:25.537728 --- ParallelTerminationStrategy: PID 19394 died... 12:19:25.556612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19394): Terminated: ok {rc=0} 12:19:25.601189 --- ParallelTerminationStrategy: PID 19397 died... 12:19:25.619972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19397): Terminated: ok {rc=0} 12:19:25.707399 bus /sierra_3: Setting Powered False 12:19:26.808848 bus /sierra_3: Setting Powered False 12:19:27.927947 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:19:29.185834 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:29.193100 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:19:29.228036 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:19:29.256043 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:19:29.310800 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:19:29.345841 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:19:29.374004 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:19:29.924729 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:19:29.977798 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:29.989722 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:19:30.061377 tst mo_mt_call.py: using LAC 33898 12:19:30.189090 tst mo_mt_call.py: using RAC 238 12:19:30.319548 tst mo_mt_call.py: using CellId 33898 12:19:30.439608 tst mo_mt_call.py: using BVCI 33899 12:19:30.551027 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:30.562290 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:30.573273 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:30.584119 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:30.595099 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:30.606040 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:19:30.725578 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:19:30.865515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:31.398461 run create_hlr_db(pid=19403): Launched 12:19:31.538813 bus /sierra_2: Setting Powered False 12:19:32.603984 run create_hlr_db(pid=19403): Terminated: ok {rc=0} 12:19:33.062513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19405): Launched 12:19:33.391153 run osmo-hlr_10.42.42.2(pid=19406): Launched 12:19:33.518483 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:34.081422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19408): Launched 12:19:34.410491 run osmo-stp_10.42.42.5(pid=19410): Launched 12:19:34.537112 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:35.127934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19412): Launched 12:19:35.456043 run osmo-msc_10.42.42.6(pid=19413): Launched 12:19:35.638897 run osmo-stp_10.42.42.5(pid=19410): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19410)] 12:19:35.776553 run osmo-stp_10.42.42.5(pid=19410): stdout: | (launched: 2022-12-13_12:19:34.350920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:35.915307 run osmo-stp_10.42.42.5(pid=19410): stderr: | 20221213121934542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121934542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121934542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121934542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121934543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121934543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121934543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:36.052139 run osmo-stp_10.42.42.5(pid=19410): stdout: | (launched: 2022-12-13_12:19:34.350920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:36.182409 run osmo-stp_10.42.42.5(pid=19410): stderr: | 20221213121934542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121934542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121934542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121934542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121934543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121934543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121934543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:36.338344 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19410): Process ended prematurely: osmo-stp_10.42.42.5(pid=19410) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19410)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:19:36.348079 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:19:36.375913 run osmo-hlr_10.42.42.2(pid=19406): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19406)] 12:19:36.427225 run osmo-hlr_10.42.42.2(pid=19406): stdout: | (launched: 2022-12-13_12:19:33.331171) 12:19:36.479415 run osmo-hlr_10.42.42.2(pid=19406): stderr: | 20221213121933528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121933529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121933529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121933529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121933529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121933529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121933540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121933551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121933551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121933551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:36.552290 run osmo-msc_10.42.42.6(pid=19413): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19413)] 12:19:36.602265 run osmo-msc_10.42.42.6(pid=19413): stdout: | (launched: 2022-12-13_12:19:35.396168) 12:19:36.654212 run osmo-msc_10.42.42.6(pid=19413): stderr: | 20221213121935715 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121935716 DLGLOBAL DEBUG validating counter group 0x7f6057c03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121935716 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121935716 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121935716 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121935716 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121935718 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121935718 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121935718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121935718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:36.706720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19405): Terminating (SIGTERM) 12:19:36.748633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19408): Terminating (SIGTERM) 12:19:36.790743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19412): Terminating (SIGTERM) 12:19:36.833833 --- ParallelTerminationStrategy: PID 19405 died... 12:19:36.854531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19405): Terminated: ok {rc=0} 12:19:36.901326 --- ParallelTerminationStrategy: PID 19408 died... 12:19:36.921503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19408): Terminated: ok {rc=0} 12:19:36.968527 --- ParallelTerminationStrategy: PID 19412 died... 12:19:36.988716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19412): Terminated: ok {rc=0} 12:19:37.078821 bus /sierra_3: Setting Powered False 12:19:38.179368 bus /sierra_3: Setting Powered False 12:19:39.297171 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:19:40.447055 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:40.459544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:19:40.533216 tst mo_mt_call_osmux.py: using LAC 33899 12:19:40.660312 tst mo_mt_call_osmux.py: using RAC 239 12:19:40.790361 tst mo_mt_call_osmux.py: using CellId 33899 12:19:40.920180 tst mo_mt_call_osmux.py: using BVCI 33900 12:19:41.040754 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:41.052539 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:41.064212 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:41.075596 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:41.087445 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:19:41.099243 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:19:41.218398 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:19:41.339633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:41.847998 run create_hlr_db(pid=19415): Launched 12:19:41.974425 bus /sierra_2: Setting Powered False 12:19:43.038692 run create_hlr_db(pid=19415): Terminated: ok {rc=0} 12:19:43.476324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19417): Launched 12:19:43.783164 run osmo-hlr_10.42.42.2(pid=19418): Launched 12:19:43.900174 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:44.444068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19420): Launched 12:19:44.750333 run osmo-stp_10.42.42.5(pid=19421): Launched 12:19:44.866878 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:45.419870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19423): Launched 12:19:45.726327 run osmo-msc_10.42.42.6(pid=19424): Launched 12:19:46.057349 run osmo-stp_10.42.42.5(pid=19421): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19421)] 12:19:46.233969 run osmo-stp_10.42.42.5(pid=19421): stdout: | (launched: 2022-12-13_12:19:44.694248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:46.375904 run osmo-stp_10.42.42.5(pid=19421): stderr: | 20221213121944861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121944862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121944862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121944862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121944863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121944863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121944863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:46.519341 run osmo-stp_10.42.42.5(pid=19421): stdout: | (launched: 2022-12-13_12:19:44.694248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:46.656049 run osmo-stp_10.42.42.5(pid=19421): stderr: | 20221213121944861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121944862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121944862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121944862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121944863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121944863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121944863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:46.841808 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19421): Process ended prematurely: osmo-stp_10.42.42.5(pid=19421) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19421)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:19:46.852891 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:19:46.882641 run osmo-hlr_10.42.42.2(pid=19418): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19418)] 12:19:46.939300 run osmo-hlr_10.42.42.2(pid=19418): stdout: | (launched: 2022-12-13_12:19:43.727013) 12:19:46.995091 run osmo-hlr_10.42.42.2(pid=19418): stderr: | 20221213121943901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121943901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121943901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121943901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121943901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121943901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121943913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121943925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121943925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121943925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:47.071264 run osmo-msc_10.42.42.6(pid=19424): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19424)] 12:19:47.125697 run osmo-msc_10.42.42.6(pid=19424): stdout: | (launched: 2022-12-13_12:19:45.670133) 12:19:47.180631 run osmo-msc_10.42.42.6(pid=19424): stderr: | 20221213121945965 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121945966 DLGLOBAL DEBUG validating counter group 0x7f6fbefebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121945966 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121945966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121945966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121945966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121945968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121945968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121945968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121945968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:47.236511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19417): Terminating (SIGTERM) 12:19:47.280466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19420): Terminating (SIGTERM) 12:19:47.324339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19423): Terminating (SIGTERM) 12:19:47.367631 --- ParallelTerminationStrategy: PID 19417 died... 12:19:47.388465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19417): Terminated: ok {rc=0} 12:19:47.435832 --- ParallelTerminationStrategy: PID 19420 died... 12:19:47.456160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19420): Terminated: ok {rc=0} 12:19:47.505370 --- ParallelTerminationStrategy: PID 19423 died... 12:19:47.524186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19423): Terminated: ok {rc=0} 12:19:47.609861 bus /sierra_3: Setting Powered False 12:19:48.709147 bus /sierra_3: Setting Powered False 12:19:49.823994 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:19:51.076120 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:51.082665 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:19:51.115594 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:19:51.142240 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:19:51.193789 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:19:51.227038 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:19:51.253449 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:19:51.809271 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:19:51.862814 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:19:51.874738 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:19:51.947324 tst mo_mt_call.py: using LAC 33900 12:19:52.075922 tst mo_mt_call.py: using RAC 240 12:19:52.204719 tst mo_mt_call.py: using CellId 33900 12:19:52.332650 tst mo_mt_call.py: using BVCI 33901 12:19:52.444905 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:19:52.456224 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:19:52.467363 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:19:52.478558 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:19:52.489939 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:19:52.501290 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:19:52.621035 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:19:52.737302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:53.214089 run create_hlr_db(pid=19429): Launched 12:19:53.341154 bus /sierra_2: Setting Powered False 12:19:54.402065 run create_hlr_db(pid=19429): Terminated: ok {rc=0} 12:19:54.850372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19431): Launched 12:19:55.177854 run osmo-hlr_10.42.42.2(pid=19432): Launched 12:19:55.303780 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:55.867627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19434): Launched 12:19:56.195854 run osmo-stp_10.42.42.5(pid=19435): Launched 12:19:56.319795 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:56.909716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19437): Launched 12:19:57.237970 run osmo-msc_10.42.42.6(pid=19438): Launched 12:19:57.421057 run osmo-stp_10.42.42.5(pid=19435): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19435)] 12:19:57.559198 run osmo-stp_10.42.42.5(pid=19435): stdout: | (launched: 2022-12-13_12:19:56.136228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:57.697441 run osmo-stp_10.42.42.5(pid=19435): stderr: | 20221213121956328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121956328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121956328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121956328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121956329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121956329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121956329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:57.833788 run osmo-stp_10.42.42.5(pid=19435): stdout: | (launched: 2022-12-13_12:19:56.136228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:57.964279 run osmo-stp_10.42.42.5(pid=19435): stderr: | 20221213121956328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213121956328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213121956328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213121956328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213121956329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213121956329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213121956329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:58.119856 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19435): Process ended prematurely: osmo-stp_10.42.42.5(pid=19435) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19435)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:19:58.129546 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:19:58.157698 run osmo-hlr_10.42.42.2(pid=19432): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19432)] 12:19:58.208765 run osmo-hlr_10.42.42.2(pid=19432): stdout: | (launched: 2022-12-13_12:19:55.118169) 12:19:58.261656 run osmo-hlr_10.42.42.2(pid=19432): stderr: | 20221213121955315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213121955315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213121955315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213121955315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213121955315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213121955315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213121955327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213121955336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213121955336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213121955336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:58.335188 run osmo-msc_10.42.42.6(pid=19438): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19438)] 12:19:58.385745 run osmo-msc_10.42.42.6(pid=19438): stdout: | (launched: 2022-12-13_12:19:57.178054) 12:19:58.438265 run osmo-msc_10.42.42.6(pid=19438): stderr: | 20221213121957500 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213121957500 DLGLOBAL DEBUG validating counter group 0x7f97b891cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213121957500 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213121957500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213121957500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213121957500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213121957502 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213121957502 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213121957503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213121957503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:58.491410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19431): Terminating (SIGTERM) 12:19:58.533300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19434): Terminating (SIGTERM) 12:19:58.575748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19437): Terminating (SIGTERM) 12:19:58.618013 --- ParallelTerminationStrategy: PID 19431 died... 12:19:58.638472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19431): Terminated: ok {rc=0} 12:19:58.685069 --- ParallelTerminationStrategy: PID 19434 died... 12:19:58.705036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19434): Terminated: ok {rc=0} 12:19:58.751978 --- ParallelTerminationStrategy: PID 19437 died... 12:19:58.772048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19437): Terminated: ok {rc=0} 12:19:58.862068 bus /sierra_3: Setting Powered False 12:19:59.962211 bus /sierra_3: Setting Powered False 12:20:01.080093 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:20:02.235889 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:02.247894 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:20:02.317531 tst mo_mt_call_osmux.py: using LAC 33901 12:20:02.446857 tst mo_mt_call_osmux.py: using RAC 241 12:20:02.575719 tst mo_mt_call_osmux.py: using CellId 33901 12:20:02.705875 tst mo_mt_call_osmux.py: using BVCI 33902 12:20:02.817865 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:02.829353 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:02.840392 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:02.851538 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:02.862851 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:02.874098 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:20:02.994884 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:20:03.113121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:03.589157 run create_hlr_db(pid=19443): Launched 12:20:03.714443 bus /sierra_2: Setting Powered False 12:20:04.778860 run create_hlr_db(pid=19443): Terminated: ok {rc=0} 12:20:05.218090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19445): Launched 12:20:05.525568 run osmo-hlr_10.42.42.2(pid=19446): Launched 12:20:05.642303 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:06.176539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19448): Launched 12:20:06.483581 run osmo-stp_10.42.42.5(pid=19449): Launched 12:20:06.600243 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:07.154236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19451): Launched 12:20:07.462897 run osmo-msc_10.42.42.6(pid=19452): Launched 12:20:07.636168 run osmo-stp_10.42.42.5(pid=19449): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19449)] 12:20:07.766542 run osmo-stp_10.42.42.5(pid=19449): stdout: | (launched: 2022-12-13_12:20:06.427446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:07.896752 run osmo-stp_10.42.42.5(pid=19449): stderr: | 20221213122006596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122006596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122006597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122006597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122006598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122006598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122006598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:08.024762 run osmo-stp_10.42.42.5(pid=19449): stdout: | (launched: 2022-12-13_12:20:06.427446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:08.147171 run osmo-stp_10.42.42.5(pid=19449): stderr: | 20221213122006596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122006596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122006597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122006597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122006598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122006598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122006598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:08.293983 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19449): Process ended prematurely: osmo-stp_10.42.42.5(pid=19449) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19449)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:20:08.303192 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:20:08.330443 run osmo-hlr_10.42.42.2(pid=19446): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19446)] 12:20:08.379561 run osmo-hlr_10.42.42.2(pid=19446): stdout: | (launched: 2022-12-13_12:20:05.469231) 12:20:08.429847 run osmo-hlr_10.42.42.2(pid=19446): stderr: | 20221213122005642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122005642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122005642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122005642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122005642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122005642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122005655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122005663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122005663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122005664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:08.500197 run osmo-msc_10.42.42.6(pid=19452): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19452)] 12:20:08.548723 run osmo-msc_10.42.42.6(pid=19452): stdout: | (launched: 2022-12-13_12:20:07.406139) 12:20:08.598985 run osmo-msc_10.42.42.6(pid=19452): stderr: | 20221213122007678 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122007678 DLGLOBAL DEBUG validating counter group 0x7f6df4ec8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122007678 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122007678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122007678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122007679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122007680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122007681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122007681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122007681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:08.650410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19445): Terminating (SIGTERM) 12:20:08.691114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19448): Terminating (SIGTERM) 12:20:08.731928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19451): Terminating (SIGTERM) 12:20:08.772665 --- ParallelTerminationStrategy: PID 19445 died... 12:20:08.792511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19445): Terminated: ok {rc=0} 12:20:08.837647 --- ParallelTerminationStrategy: PID 19448 died... 12:20:08.856553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19448): Terminated: ok {rc=0} 12:20:08.901769 --- ParallelTerminationStrategy: PID 19451 died... 12:20:08.921055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19451): Terminated: ok {rc=0} 12:20:09.008453 bus /sierra_3: Setting Powered False 12:20:10.109342 bus /sierra_3: Setting Powered False 12:20:11.227005 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:20:12.484880 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:12.491729 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:20:12.524838 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:20:12.551887 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:20:12.602963 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:20:12.635805 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:20:12.662238 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:20:13.214728 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:20:13.263637 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:13.274980 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:20:13.347790 tst mo_mt_call.py: using LAC 33902 12:20:13.467473 tst mo_mt_call.py: using RAC 242 12:20:13.587605 tst mo_mt_call.py: using CellId 33902 12:20:13.707200 tst mo_mt_call.py: using BVCI 33903 12:20:13.819675 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:13.830832 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:13.841786 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:13.852586 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:13.863586 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:13.874599 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:13.997303 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:14.116442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:14.624400 run create_hlr_db(pid=19457): Launched 12:20:14.750686 bus /sierra_2: Setting Powered False 12:20:15.815422 run create_hlr_db(pid=19457): Terminated: ok {rc=0} 12:20:16.351678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19459): Launched 12:20:16.700604 run osmo-hlr_10.42.42.2(pid=19460): Launched 12:20:16.871157 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:17.586363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19462): Launched 12:20:17.915570 run osmo-stp_10.42.42.5(pid=19463): Launched 12:20:18.040595 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:18.631515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19465): Launched 12:20:18.961227 run osmo-msc_10.42.42.6(pid=19466): Launched 12:20:19.145943 run osmo-stp_10.42.42.5(pid=19463): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19463)] 12:20:19.283922 run osmo-stp_10.42.42.5(pid=19463): stdout: | (launched: 2022-12-13_12:20:17.855010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:19.422614 run osmo-stp_10.42.42.5(pid=19463): stderr: | 20221213122018045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122018045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122018045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122018045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122018046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122018046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122018046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:19.559179 run osmo-stp_10.42.42.5(pid=19463): stdout: | (launched: 2022-12-13_12:20:17.855010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:19.689921 run osmo-stp_10.42.42.5(pid=19463): stderr: | 20221213122018045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122018045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122018045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122018045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122018046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122018046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122018046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:19.845856 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19463): Process ended prematurely: osmo-stp_10.42.42.5(pid=19463) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19463)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:20:19.855858 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:20:19.884243 run osmo-hlr_10.42.42.2(pid=19460): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19460)] 12:20:19.935810 run osmo-hlr_10.42.42.2(pid=19460): stdout: | (launched: 2022-12-13_12:20:16.637257) 12:20:19.988591 run osmo-hlr_10.42.42.2(pid=19460): stderr: | 20221213122016970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122016971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122016971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122016971 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122016971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122016971 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122016986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122017003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122017003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122017003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:20.062292 run osmo-msc_10.42.42.6(pid=19466): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19466)] 12:20:20.112423 run osmo-msc_10.42.42.6(pid=19466): stdout: | (launched: 2022-12-13_12:20:18.901483) 12:20:20.165476 run osmo-msc_10.42.42.6(pid=19466): stderr: | 20221213122019220 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122019220 DLGLOBAL DEBUG validating counter group 0x7fa0a3b66c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122019220 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122019220 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122019220 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122019221 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122019222 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122019223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122019223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122019223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:20.218302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19459): Terminating (SIGTERM) 12:20:20.260569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19462): Terminating (SIGTERM) 12:20:20.303075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19465): Terminating (SIGTERM) 12:20:20.346084 --- ParallelTerminationStrategy: PID 19459 died... 12:20:20.366542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19459): Terminated: ok {rc=0} 12:20:20.413218 --- ParallelTerminationStrategy: PID 19462 died... 12:20:20.433220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19462): Terminated: ok {rc=0} 12:20:20.480212 --- ParallelTerminationStrategy: PID 19465 died... 12:20:20.500371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19465): Terminated: ok {rc=0} 12:20:20.590041 bus /sierra_3: Setting Powered False 12:20:21.690072 bus /sierra_3: Setting Powered False 12:20:22.806865 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:20:23.958856 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:23.971038 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:20:24.051944 tst mo_mt_call_osmux.py: using LAC 33903 12:20:24.192578 tst mo_mt_call_osmux.py: using RAC 243 12:20:24.323802 tst mo_mt_call_osmux.py: using CellId 33903 12:20:24.452693 tst mo_mt_call_osmux.py: using BVCI 33904 12:20:24.572393 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:24.584102 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:24.595530 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:24.606965 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:24.618741 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:24.630534 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:24.748281 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:24.870214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:25.376632 run create_hlr_db(pid=19468): Launched 12:20:25.502061 bus /sierra_2: Setting Powered False 12:20:26.567002 run create_hlr_db(pid=19468): Terminated: ok {rc=0} 12:20:27.023127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19470): Launched 12:20:27.352003 run osmo-hlr_10.42.42.2(pid=19471): Launched 12:20:27.476763 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:28.042185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19473): Launched 12:20:28.369865 run osmo-stp_10.42.42.5(pid=19474): Launched 12:20:28.495302 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:29.085886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19476): Launched 12:20:29.415568 run osmo-msc_10.42.42.6(pid=19477): Launched 12:20:29.600151 run osmo-stp_10.42.42.5(pid=19474): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19474)] 12:20:29.738173 run osmo-stp_10.42.42.5(pid=19474): stdout: | (launched: 2022-12-13_12:20:28.310322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:29.877945 run osmo-stp_10.42.42.5(pid=19474): stderr: | 20221213122028500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122028500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122028500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122028501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122028501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122028501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122028501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:30.015360 run osmo-stp_10.42.42.5(pid=19474): stdout: | (launched: 2022-12-13_12:20:28.310322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:30.145187 run osmo-stp_10.42.42.5(pid=19474): stderr: | 20221213122028500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122028500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122028500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122028501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122028501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122028501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122028501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:30.300272 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19474): Process ended prematurely: osmo-stp_10.42.42.5(pid=19474) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19474)] [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:20:30.310306 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:20:30.338695 run osmo-hlr_10.42.42.2(pid=19471): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19471)] 12:20:30.390309 run osmo-hlr_10.42.42.2(pid=19471): stdout: | (launched: 2022-12-13_12:20:27.292488) 12:20:30.443316 run osmo-hlr_10.42.42.2(pid=19471): stderr: | 20221213122027487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122027487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122027487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122027487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122027487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122027487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122027503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122027513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122027514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122027514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:30.516816 run osmo-msc_10.42.42.6(pid=19477): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19477)] 12:20:30.567863 run osmo-msc_10.42.42.6(pid=19477): stdout: | (launched: 2022-12-13_12:20:29.355554) 12:20:30.620813 run osmo-msc_10.42.42.6(pid=19477): stderr: | 20221213122029674 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122029674 DLGLOBAL DEBUG validating counter group 0x7efd07936c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122029674 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122029674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122029674 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122029675 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122029676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122029677 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122029677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122029677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:30.673967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19470): Terminating (SIGTERM) 12:20:30.715842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19473): Terminating (SIGTERM) 12:20:30.758763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19476): Terminating (SIGTERM) 12:20:30.801403 --- ParallelTerminationStrategy: PID 19470 died... 12:20:30.822574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19470): Terminated: ok {rc=0} 12:20:30.870394 --- ParallelTerminationStrategy: PID 19473 died... 12:20:30.891519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19473): Terminated: ok {rc=0} 12:20:30.939437 --- ParallelTerminationStrategy: PID 19476 died... 12:20:30.960233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19476): Terminated: ok {rc=0} 12:20:31.051493 bus /sierra_3: Setting Powered False 12:20:32.152614 bus /sierra_3: Setting Powered False 12:20:33.270796 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:20:34.531534 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:34.538805 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:20:34.573737 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:20:34.602099 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:20:34.658083 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:20:34.693349 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:20:34.721375 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:20:35.272040 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:20:35.325731 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:35.337702 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:20:35.411358 tst mo_mt_call.py: using LAC 33904 12:20:35.540634 tst mo_mt_call.py: using RAC 244 12:20:35.671182 tst mo_mt_call.py: using CellId 33904 12:20:35.791931 tst mo_mt_call.py: using BVCI 33905 12:20:35.904493 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:35.915769 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:35.927052 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:35.938070 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:35.949240 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:35.960214 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:20:36.080752 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:20:36.197571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:36.673126 run create_hlr_db(pid=19482): Launched 12:20:36.798341 bus /sierra_2: Setting Powered False 12:20:37.859512 run create_hlr_db(pid=19482): Terminated: ok {rc=0} 12:20:38.307961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19484): Launched 12:20:38.635258 run osmo-hlr_10.42.42.2(pid=19485): Launched 12:20:38.760925 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:39.325335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19487): Launched 12:20:39.654115 run osmo-stp_10.42.42.5(pid=19488): Launched 12:20:39.780134 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:40.370220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19490): Launched 12:20:40.696750 run osmo-msc_10.42.42.6(pid=19491): Launched 12:20:40.880547 run osmo-stp_10.42.42.5(pid=19488): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19488)] 12:20:41.018138 run osmo-stp_10.42.42.5(pid=19488): stdout: | (launched: 2022-12-13_12:20:39.594479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:41.156298 run osmo-stp_10.42.42.5(pid=19488): stderr: | 20221213122039785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122039785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122039785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122039786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122039786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122039786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122039786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:41.292921 run osmo-stp_10.42.42.5(pid=19488): stdout: | (launched: 2022-12-13_12:20:39.594479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:41.422922 run osmo-stp_10.42.42.5(pid=19488): stderr: | 20221213122039785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122039785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122039785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122039786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122039786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122039786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122039786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:41.578568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19488): Process ended prematurely: osmo-stp_10.42.42.5(pid=19488) [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19488)] [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:20:41.588501 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:20:41.616719 run osmo-hlr_10.42.42.2(pid=19485): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19485)] 12:20:41.667831 run osmo-hlr_10.42.42.2(pid=19485): stdout: | (launched: 2022-12-13_12:20:38.575578) 12:20:41.720687 run osmo-hlr_10.42.42.2(pid=19485): stderr: | 20221213122038773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122038773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122038773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122038773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122038773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122038774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122038786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122038795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122038795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122038795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:41.793926 run osmo-msc_10.42.42.6(pid=19491): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19491)] 12:20:41.844154 run osmo-msc_10.42.42.6(pid=19491): stdout: | (launched: 2022-12-13_12:20:40.636863) 12:20:41.897888 run osmo-msc_10.42.42.6(pid=19491): stderr: | 20221213122040959 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122040959 DLGLOBAL DEBUG validating counter group 0x7fe5c0188c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122040959 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122040959 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122040959 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122040959 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122040961 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122040962 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122040962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122040962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:41.952518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19484): Terminating (SIGTERM) 12:20:41.994979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19487): Terminating (SIGTERM) 12:20:42.037426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19490): Terminating (SIGTERM) 12:20:42.079781 --- ParallelTerminationStrategy: PID 19484 died... 12:20:42.100247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19484): Terminated: ok {rc=0} 12:20:42.147079 --- ParallelTerminationStrategy: PID 19487 died... 12:20:42.167020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19487): Terminated: ok {rc=0} 12:20:42.213536 --- ParallelTerminationStrategy: PID 19490 died... 12:20:42.233651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19490): Terminated: ok {rc=0} 12:20:42.322647 bus /sierra_3: Setting Powered False 12:20:43.421373 bus /sierra_3: Setting Powered False 12:20:44.538130 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:20:45.688772 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:45.701397 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:20:45.775962 tst mo_mt_call_osmux.py: using LAC 33905 12:20:45.919438 tst mo_mt_call_osmux.py: using RAC 245 12:20:46.053642 tst mo_mt_call_osmux.py: using CellId 33905 12:20:46.194900 tst mo_mt_call_osmux.py: using BVCI 33906 12:20:46.308414 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:46.321980 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:46.334282 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:46.347028 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:46.365173 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:20:46.384300 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:20:46.522043 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:20:46.640677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:47.243681 run create_hlr_db(pid=19493): Launched 12:20:47.399778 bus /sierra_2: Setting Powered False 12:20:48.464205 run create_hlr_db(pid=19493): Terminated: ok {rc=0} 12:20:48.920469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19495): Launched 12:20:49.247964 run osmo-hlr_10.42.42.2(pid=19496): Launched 12:20:49.373264 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:49.939211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19498): Launched 12:20:50.267677 run osmo-stp_10.42.42.5(pid=19499): Launched 12:20:50.393579 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:50.991031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19501): Launched 12:20:51.321253 run osmo-msc_10.42.42.6(pid=19502): Launched 12:20:51.503918 run osmo-stp_10.42.42.5(pid=19499): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19499)] 12:20:51.643260 run osmo-stp_10.42.42.5(pid=19499): stdout: | (launched: 2022-12-13_12:20:50.207929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:51.782864 run osmo-stp_10.42.42.5(pid=19499): stderr: | 20221213122050402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122050402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122050402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122050402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122050403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122050403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122050403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:51.918946 run osmo-stp_10.42.42.5(pid=19499): stdout: | (launched: 2022-12-13_12:20:50.207929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:52.040018 run osmo-stp_10.42.42.5(pid=19499): stderr: | 20221213122050402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122050402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122050402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122050402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122050403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122050403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122050403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:52.186239 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19499): Process ended prematurely: osmo-stp_10.42.42.5(pid=19499) [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19499)] [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:20:52.195298 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:20:52.222046 run osmo-hlr_10.42.42.2(pid=19496): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19496)] 12:20:52.269648 run osmo-hlr_10.42.42.2(pid=19496): stdout: | (launched: 2022-12-13_12:20:49.188158) 12:20:52.318991 run osmo-hlr_10.42.42.2(pid=19496): stderr: | 20221213122049383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122049383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122049383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122049383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122049383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122049383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122049401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122049411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122049411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122049411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:52.387906 run osmo-msc_10.42.42.6(pid=19502): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19502)] 12:20:52.435468 run osmo-msc_10.42.42.6(pid=19502): stdout: | (launched: 2022-12-13_12:20:51.261139) 12:20:52.484839 run osmo-msc_10.42.42.6(pid=19502): stderr: | 20221213122051581 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122051581 DLGLOBAL DEBUG validating counter group 0x7f672cc8bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122051581 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122051582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122051582 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122051582 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122051584 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122051584 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122051584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122051584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:52.534622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19495): Terminating (SIGTERM) 12:20:52.574347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19498): Terminating (SIGTERM) 12:20:52.614234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19501): Terminating (SIGTERM) 12:20:52.654202 --- ParallelTerminationStrategy: PID 19495 died... 12:20:52.673659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19495): Terminated: ok {rc=0} 12:20:52.718083 --- ParallelTerminationStrategy: PID 19498 died... 12:20:52.737507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19498): Terminated: ok {rc=0} 12:20:52.781329 --- ParallelTerminationStrategy: PID 19501 died... 12:20:52.800066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19501): Terminated: ok {rc=0} 12:20:52.884457 bus /sierra_3: Setting Powered False 12:20:53.982672 bus /sierra_3: Setting Powered False 12:20:55.098307 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:20:56.356527 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:56.362840 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:20:56.397039 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:20:56.425435 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:20:56.479963 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:20:56.514990 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:20:56.542767 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:20:57.091351 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:20:57.144267 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:20:57.155731 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:20:57.227986 tst mo_mt_call.py: using LAC 33906 12:20:57.350552 tst mo_mt_call.py: using RAC 246 12:20:57.472873 tst mo_mt_call.py: using CellId 33906 12:20:57.594968 tst mo_mt_call.py: using BVCI 33907 12:20:57.708387 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:20:57.719530 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:20:57.730306 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:20:57.740994 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:20:57.751712 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:20:57.762494 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:20:57.877482 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:20:57.997641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:58.504807 run create_hlr_db(pid=19508): Launched 12:20:58.631836 bus /sierra_2: Setting Powered False 12:20:59.697351 run create_hlr_db(pid=19508): Terminated: ok {rc=0} 12:21:00.138506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19510): Launched 12:21:00.447800 run osmo-hlr_10.42.42.2(pid=19511): Launched 12:21:00.564688 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:01.167246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19513): Launched 12:21:01.519392 run osmo-stp_10.42.42.5(pid=19514): Launched 12:21:01.763072 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:02.427859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19516): Launched 12:21:02.757423 run osmo-msc_10.42.42.6(pid=19517): Launched 12:21:02.942503 run osmo-stp_10.42.42.5(pid=19514): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19514)] 12:21:03.081245 run osmo-stp_10.42.42.5(pid=19514): stdout: | (launched: 2022-12-13_12:21:01.456528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:03.220568 run osmo-stp_10.42.42.5(pid=19514): stderr: | 20221213122101702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122101702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122101702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122101703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122101703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122101703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122101703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:03.358512 run osmo-stp_10.42.42.5(pid=19514): stdout: | (launched: 2022-12-13_12:21:01.456528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:03.489817 run osmo-stp_10.42.42.5(pid=19514): stderr: | 20221213122101702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122101702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122101702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122101703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122101703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122101703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122101703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:03.647032 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19514): Process ended prematurely: osmo-stp_10.42.42.5(pid=19514) [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19514)] [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:21:03.656851 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:21:03.684795 run osmo-hlr_10.42.42.2(pid=19511): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19511)] 12:21:03.736130 run osmo-hlr_10.42.42.2(pid=19511): stdout: | (launched: 2022-12-13_12:21:00.391492) 12:21:03.789208 run osmo-hlr_10.42.42.2(pid=19511): stderr: | 20221213122100568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122100568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122100568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122100569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122100569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122100569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122100581 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122100590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122100590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122100590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:03.862757 run osmo-msc_10.42.42.6(pid=19517): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19517)] 12:21:03.913572 run osmo-msc_10.42.42.6(pid=19517): stdout: | (launched: 2022-12-13_12:21:02.697593) 12:21:03.966487 run osmo-msc_10.42.42.6(pid=19517): stderr: | 20221213122103018 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122103018 DLGLOBAL DEBUG validating counter group 0x7fd555afec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122103018 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122103018 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122103019 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122103019 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122103020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122103021 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122103021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122103021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:04.019076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19510): Terminating (SIGTERM) 12:21:04.061665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19513): Terminating (SIGTERM) 12:21:04.104257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19516): Terminating (SIGTERM) 12:21:04.147051 --- ParallelTerminationStrategy: PID 19510 died... 12:21:04.167826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19510): Terminated: ok {rc=0} 12:21:04.214878 --- ParallelTerminationStrategy: PID 19513 died... 12:21:04.235126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19513): Terminated: ok {rc=0} 12:21:04.281917 --- ParallelTerminationStrategy: PID 19516 died... 12:21:04.302061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19516): Terminated: ok {rc=0} 12:21:04.392209 bus /sierra_3: Setting Powered False 12:21:05.493031 bus /sierra_3: Setting Powered False 12:21:06.610336 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:21:07.757999 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:07.769700 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:21:07.840638 tst mo_mt_call_osmux.py: using LAC 33907 12:21:07.963538 tst mo_mt_call_osmux.py: using RAC 247 12:21:08.084315 tst mo_mt_call_osmux.py: using CellId 33907 12:21:08.206706 tst mo_mt_call_osmux.py: using BVCI 33908 12:21:08.319746 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:08.330800 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:08.342079 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:08.352927 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:08.363902 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:08.374834 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:21:08.490420 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:21:08.607796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:09.082462 run create_hlr_db(pid=19519): Launched 12:21:09.209315 bus /sierra_2: Setting Powered False 12:21:10.270610 run create_hlr_db(pid=19519): Terminated: ok {rc=0} 12:21:10.717730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19521): Launched 12:21:11.046328 run osmo-hlr_10.42.42.2(pid=19522): Launched 12:21:11.172915 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:11.737071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19524): Launched 12:21:12.064408 run osmo-stp_10.42.42.5(pid=19525): Launched 12:21:12.189750 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:12.780361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19527): Launched 12:21:13.109560 run osmo-msc_10.42.42.6(pid=19528): Launched 12:21:13.294416 run osmo-stp_10.42.42.5(pid=19525): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19525)] 12:21:13.432606 run osmo-stp_10.42.42.5(pid=19525): stdout: | (launched: 2022-12-13_12:21:12.004836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:13.571374 run osmo-stp_10.42.42.5(pid=19525): stderr: | 20221213122112196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122112196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122112196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122112196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122112197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122112197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122112197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:13.708676 run osmo-stp_10.42.42.5(pid=19525): stdout: | (launched: 2022-12-13_12:21:12.004836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:13.839264 run osmo-stp_10.42.42.5(pid=19525): stderr: | 20221213122112196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122112196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122112196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122112196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122112197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122112197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122112197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:13.996622 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19525): Process ended prematurely: osmo-stp_10.42.42.5(pid=19525) [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19525)] [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:21:14.006379 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:21:14.034474 run osmo-hlr_10.42.42.2(pid=19522): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19522)] 12:21:14.085157 run osmo-hlr_10.42.42.2(pid=19522): stdout: | (launched: 2022-12-13_12:21:10.986788) 12:21:14.137935 run osmo-hlr_10.42.42.2(pid=19522): stderr: | 20221213122111184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122111184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122111184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122111184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122111184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122111184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122111200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122111209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122111209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122111209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:14.210594 run osmo-msc_10.42.42.6(pid=19528): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19528)] 12:21:14.260662 run osmo-msc_10.42.42.6(pid=19528): stdout: | (launched: 2022-12-13_12:21:13.049815) 12:21:14.313260 run osmo-msc_10.42.42.6(pid=19528): stderr: | 20221213122113368 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122113369 DLGLOBAL DEBUG validating counter group 0x7f7005603c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122113369 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122113369 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122113369 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122113369 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122113371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122113371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122113371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122113371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:14.365864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19521): Terminating (SIGTERM) 12:21:14.407649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19524): Terminating (SIGTERM) 12:21:14.450259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19527): Terminating (SIGTERM) 12:21:14.492566 --- ParallelTerminationStrategy: PID 19521 died... 12:21:14.513141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19521): Terminated: ok {rc=0} 12:21:14.559949 --- ParallelTerminationStrategy: PID 19524 died... 12:21:14.579838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19524): Terminated: ok {rc=0} 12:21:14.626566 --- ParallelTerminationStrategy: PID 19527 died... 12:21:14.646729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19527): Terminated: ok {rc=0} 12:21:14.736408 bus /sierra_3: Setting Powered False 12:21:15.836417 bus /sierra_3: Setting Powered False 12:21:17.000276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 emergency:trx-lms --------------------------------------------------------------------- 12:21:18.255060 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:18.259551 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 12:21:18.305098 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:21:18.332795 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 12:21:18.420603 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 12:21:18.455140 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:21:18.483050 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 12:21:19.068445 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2389 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 12:21:19.073849 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:19.084927 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 12:21:19.138662 tst emergency_mo_mt_call.py: using LAC 33908 12:21:19.265055 tst emergency_mo_mt_call.py: using RAC 248 12:21:19.391395 tst emergency_mo_mt_call.py: using CellId 33908 12:21:19.516316 tst emergency_mo_mt_call.py: using BVCI 33909 12:21:19.632894 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:19.644105 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:19.655083 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:19.666138 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:19.677443 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:19.688619 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:21:19.807411 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:21:19.929951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:20.428325 run create_hlr_db(pid=19533): Launched 12:21:20.553516 bus /sierra_2: Setting Powered False 12:21:21.617645 run create_hlr_db(pid=19533): Terminated: ok {rc=0} 12:21:22.048616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19535): Launched 12:21:22.350145 run osmo-hlr_10.42.42.2(pid=19536): Launched 12:21:22.464900 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:22.989632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19538): Launched 12:21:23.292511 run osmo-stp_10.42.42.5(pid=19539): Launched 12:21:23.416617 tst emergency_mo_mt_call.py: using MSISDN 8150 12:21:23.570190 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:24.114622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19541): Launched 12:21:24.416080 run osmo-msc_10.42.42.6(pid=19542): Launched 12:21:24.584081 run osmo-stp_10.42.42.5(pid=19539): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19539)] 12:21:24.710665 run osmo-stp_10.42.42.5(pid=19539): stdout: | (launched: 2022-12-13_12:21:23.236890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:24.837480 run osmo-stp_10.42.42.5(pid=19539): stderr: | 20221213122123407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122123407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122123407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122123408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122123408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122123408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122123408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:24.962909 run osmo-stp_10.42.42.5(pid=19539): stdout: | (launched: 2022-12-13_12:21:23.236890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:25.083281 run osmo-stp_10.42.42.5(pid=19539): stderr: | 20221213122123407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122123407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122123407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122123408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122123408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122123408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122123408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:25.226495 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19539): Process ended prematurely: osmo-stp_10.42.42.5(pid=19539) [trial-2389↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19539)] [trial-2389↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 12:21:25.235122 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 12:21:25.261525 run osmo-hlr_10.42.42.2(pid=19536): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19536)] 12:21:25.309838 run osmo-hlr_10.42.42.2(pid=19536): stdout: | (launched: 2022-12-13_12:21:22.294909) 12:21:25.359577 run osmo-hlr_10.42.42.2(pid=19536): stderr: | 20221213122122469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122122469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122122469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122122469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122122469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122122469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122122482 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122122490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122122491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122122491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:25.428605 run osmo-msc_10.42.42.6(pid=19542): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19542)] 12:21:25.476338 run osmo-msc_10.42.42.6(pid=19542): stdout: | (launched: 2022-12-13_12:21:24.360437) 12:21:25.525776 run osmo-msc_10.42.42.6(pid=19542): stderr: | 20221213122124632 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122124632 DLGLOBAL DEBUG validating counter group 0x7f75221aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122124632 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122124632 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122124632 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122124632 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122124634 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122124635 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122124635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122124635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:25.575809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19535): Terminating (SIGTERM) 12:21:25.615812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19538): Terminating (SIGTERM) 12:21:25.655757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19541): Terminating (SIGTERM) 12:21:25.697381 --- ParallelTerminationStrategy: PID 19535 died... 12:21:25.716805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19535): Terminated: ok {rc=0} 12:21:25.761284 --- ParallelTerminationStrategy: PID 19538 died... 12:21:25.780177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19538): Terminated: ok {rc=0} 12:21:25.824346 --- ParallelTerminationStrategy: PID 19541 died... 12:21:25.843431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19541): Terminated: ok {rc=0} 12:21:25.927858 bus /sierra_3: Setting Powered False 12:21:27.026841 bus /sierra_3: Setting Powered False 12:21:28.142751 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 12:21:29.229955 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:29.241913 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 12:21:29.294325 tst emergency_preemptive_call.py: using LAC 33909 12:21:29.420208 tst emergency_preemptive_call.py: using RAC 249 12:21:29.547917 tst emergency_preemptive_call.py: using CellId 33909 12:21:29.674633 tst emergency_preemptive_call.py: using BVCI 33910 12:21:29.791735 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:29.803120 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:29.814343 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:29.825634 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:29.837410 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:21:29.849211 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:21:29.965162 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:21:30.084566 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:21:30.200115 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:21:30.318483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:30.785426 run create_hlr_db(pid=19544): Launched 12:21:30.962617 bus /sierra_2: Setting Powered False 12:21:32.022139 run create_hlr_db(pid=19544): Terminated: ok {rc=0} 12:21:32.462384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19546): Launched 12:21:32.765144 run osmo-hlr_10.42.42.2(pid=19547): Launched 12:21:32.879408 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:33.395597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19549): Launched 12:21:33.696332 run osmo-stp_10.42.42.5(pid=19550): Launched 12:21:33.820023 tst emergency_preemptive_call.py: using MSISDN 8151 12:21:33.988270 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:34.528468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19552): Launched 12:21:34.828475 run osmo-msc_10.42.42.6(pid=19553): Launched 12:21:34.996517 run osmo-stp_10.42.42.5(pid=19550): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19550)] 12:21:35.124264 run osmo-stp_10.42.42.5(pid=19550): stdout: | (launched: 2022-12-13_12:21:33.640669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:35.251941 run osmo-stp_10.42.42.5(pid=19550): stderr: | 20221213122133813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122133813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122133814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122133814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122133815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122133815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122133815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:35.377192 run osmo-stp_10.42.42.5(pid=19550): stdout: | (launched: 2022-12-13_12:21:33.640669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:35.495890 run osmo-stp_10.42.42.5(pid=19550): stderr: | 20221213122133813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122133813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122133814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122133814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122133815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122133815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122133815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:35.638243 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19550): Process ended prematurely: osmo-stp_10.42.42.5(pid=19550) [trial-2389↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19550)] [trial-2389↪emergency:trx-lms↪emergency_preemptive_call.py:32] 12:21:35.646504 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 12:21:35.672832 run osmo-hlr_10.42.42.2(pid=19547): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19547)] 12:21:35.721495 run osmo-hlr_10.42.42.2(pid=19547): stdout: | (launched: 2022-12-13_12:21:32.709086) 12:21:35.771862 run osmo-hlr_10.42.42.2(pid=19547): stderr: | 20221213122132884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122132884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122132884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122132884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122132884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122132884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122132896 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122132905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122132906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122132906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:35.842244 run osmo-msc_10.42.42.6(pid=19553): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19553)] 12:21:35.890606 run osmo-msc_10.42.42.6(pid=19553): stdout: | (launched: 2022-12-13_12:21:34.772883) 12:21:35.941344 run osmo-msc_10.42.42.6(pid=19553): stderr: | 20221213122135042 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122135042 DLGLOBAL DEBUG validating counter group 0x7f11aa1ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122135042 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122135042 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122135042 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122135042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122135044 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122135045 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122135045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122135045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:35.991983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19546): Terminating (SIGTERM) 12:21:36.032302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19549): Terminating (SIGTERM) 12:21:36.072577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19552): Terminating (SIGTERM) 12:21:36.113398 --- ParallelTerminationStrategy: PID 19546 died... 12:21:36.132784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19546): Terminated: ok {rc=0} 12:21:36.177395 --- ParallelTerminationStrategy: PID 19549 died... 12:21:36.196110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19549): Terminated: ok {rc=0} 12:21:36.240579 --- ParallelTerminationStrategy: PID 19552 died... 12:21:36.259521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19552): Terminated: ok {rc=0} 12:21:36.344672 bus /sierra_9: Setting Powered False 12:21:37.444686 bus /sierra_9: Setting Powered False 12:21:38.563029 bus /sierra_8: Setting Powered False 12:21:39.662660 bus /sierra_8: Setting Powered False 12:21:40.782135 bus /sierra_3: Setting Powered False 12:21:41.881086 bus /sierra_3: Setting Powered False 12:21:43.000263 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-lms --------------------------------------------------------------------- 12:21:44.280741 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:44.284935 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 12:21:44.318027 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 12:21:44.356712 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 12:21:44.446111 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 12:21:44.479770 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 12:21:44.518510 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 12:21:45.106489 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 12:21:45.156757 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:45.167509 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:21:45.216030 tst cs_paging_gprs_active.py: using LAC 33910 12:21:45.338365 tst cs_paging_gprs_active.py: using RAC 250 12:21:45.460425 tst cs_paging_gprs_active.py: using CellId 33910 12:21:45.581904 tst cs_paging_gprs_active.py: using BVCI 33911 12:21:45.692522 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:45.703243 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:45.713715 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:45.724078 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:45.734487 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:45.744821 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:45.755832 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:45.766698 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:45.777883 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:21:45.930424 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:21:46.050956 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:21:46.264018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:21:46.581815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19558): Launched 12:21:46.900039 run iperf3-srv_10.42.42.10(pid=19559): Launched 12:21:47.063713 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:21:47.305090 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:21:47.635719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19560): Launched 12:21:47.924134 run iperf3-srv_10.42.42.10(pid=19561): Launched 12:21:48.047523 tst cs_paging_gprs_active.py:38: start network... 12:21:48.268884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:48.776726 run create_hlr_db(pid=19562): Launched 12:21:48.902518 bus /sierra_2: Setting Powered False 12:21:49.967878 run create_hlr_db(pid=19562): Terminated: ok {rc=0} 12:21:50.424674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19564): Launched 12:21:50.754050 run osmo-hlr_10.42.42.2(pid=19565): Launched 12:21:50.880412 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:51.444779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19567): Launched 12:21:51.775203 run osmo-stp_10.42.42.5(pid=19568): Launched 12:21:51.902431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:21:52.468810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19570): Launched 12:21:52.595233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:21:52.873528 run patchelf(pid=19571): Launched 12:21:53.059987 run osmo-stp_10.42.42.5(pid=19568): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19568)] 12:21:53.199596 run osmo-stp_10.42.42.5(pid=19568): stdout: | (launched: 2022-12-13_12:21:51.715134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:53.340923 run osmo-stp_10.42.42.5(pid=19568): stderr: | 20221213122151906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122151906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122151906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122151907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122151907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122151907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122151907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:53.482587 run osmo-stp_10.42.42.5(pid=19568): stdout: | (launched: 2022-12-13_12:21:51.715134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:53.617325 run osmo-stp_10.42.42.5(pid=19568): stderr: | 20221213122151906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122151906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122151906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122151907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122151907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122151907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122151907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:53.777532 run patchelf(pid=19571): Terminating (SIGINT) 12:21:53.962113 run patchelf(pid=19571): Terminated: ok {rc=0} 12:21:54.095185 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19568): Process ended prematurely: osmo-stp_10.42.42.5(pid=19568) [trial-2389↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19568)] [trial-2389↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 12:21:54.105570 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 12:21:54.134305 run osmo-hlr_10.42.42.2(pid=19565): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19565)] 12:21:54.185624 run osmo-hlr_10.42.42.2(pid=19565): stdout: | (launched: 2022-12-13_12:21:50.693956) 12:21:54.238296 run osmo-hlr_10.42.42.2(pid=19565): stderr: | 20221213122150889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122150889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122150889 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122150889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122150889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122150890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122150901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122150910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122150910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122150911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:54.291383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19558): Terminating (SIGTERM) 12:21:54.333779 run iperf3-srv_10.42.42.10(pid=19559): Terminating (SIGTERM) 12:21:54.376434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19560): Terminating (SIGTERM) 12:21:54.419498 run iperf3-srv_10.42.42.10(pid=19561): Terminating (SIGTERM) 12:21:54.462019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19564): Terminating (SIGTERM) 12:21:54.504809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19567): Terminating (SIGTERM) 12:21:54.547207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19570): Terminating (SIGTERM) 12:21:54.589903 --- ParallelTerminationStrategy: PID 19558 died... 12:21:54.610490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19558): Terminated: ok {rc=0} 12:21:54.657488 --- ParallelTerminationStrategy: PID 19559 died... 12:21:54.677430 run iperf3-srv_10.42.42.10(pid=19559): Terminated {rc=256} 12:21:54.724192 --- ParallelTerminationStrategy: PID 19560 died... 12:21:54.744275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19560): Terminated: ok {rc=0} 12:21:54.790813 --- ParallelTerminationStrategy: PID 19561 died... 12:21:54.810848 run iperf3-srv_10.42.42.10(pid=19561): Terminated {rc=256} 12:21:54.857603 --- ParallelTerminationStrategy: PID 19564 died... 12:21:54.877581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19564): Terminated: ok {rc=0} 12:21:54.924513 --- ParallelTerminationStrategy: PID 19567 died... 12:21:54.945040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19567): Terminated: ok {rc=0} 12:21:54.991631 --- ParallelTerminationStrategy: PID 19570 died... 12:21:55.011612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19570): Terminated: ok {rc=0} 12:21:55.100445 bus /gobi_0: Setting Powered False 12:21:56.199741 bus /gobi_0: Setting Powered False 12:21:57.317133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms iperf3.py ---------------------------------------------- 12:21:58.468813 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:58.480458 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:21:58.537439 tst iperf3.py: using LAC 33911 12:21:58.664666 tst iperf3.py: using RAC 251 12:21:58.790829 tst iperf3.py: using CellId 33911 12:21:58.917280 tst iperf3.py: using BVCI 33912 12:21:59.036023 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:59.047286 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:59.058310 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:59.069279 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:59.080484 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:59.091806 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:59.103205 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:59.114552 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:21:59.126030 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:21:59.243142 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:21:59.451436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:21:59.761351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19572): Launched 12:22:00.030780 run iperf3-srv_10.42.42.10(pid=19573): Launched 12:22:00.148175 tst iperf3.py:8: start network... 12:22:00.354979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:00.844825 run create_hlr_db(pid=19574): Launched 12:22:01.034832 bus /gobi_6: Setting Powered False 12:22:02.106972 run create_hlr_db(pid=19574): Terminated: ok {rc=0} 12:22:02.549530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19576): Launched 12:22:02.859509 run osmo-hlr_10.42.42.2(pid=19577): Launched 12:22:02.975988 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:03.522260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19579): Launched 12:22:03.832006 run osmo-stp_10.42.42.5(pid=19580): Launched 12:22:03.948456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:04.474922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19582): Launched 12:22:04.594461 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:04.853502 run patchelf(pid=19583): Launched 12:22:05.024659 run osmo-stp_10.42.42.5(pid=19580): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19580)] 12:22:05.155196 run osmo-stp_10.42.42.5(pid=19580): stdout: | (launched: 2022-12-13_12:22:03.774637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:05.287090 run osmo-stp_10.42.42.5(pid=19580): stderr: | 20221213122203948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122203948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122203948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122203949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122203949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122203949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122203949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:05.419841 run osmo-stp_10.42.42.5(pid=19580): stdout: | (launched: 2022-12-13_12:22:03.774637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:05.545809 run osmo-stp_10.42.42.5(pid=19580): stderr: | 20221213122203948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122203948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122203948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122203949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122203949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122203949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122203949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:05.695000 run patchelf(pid=19583): Terminating (SIGINT) 12:22:05.868326 run patchelf(pid=19583): Terminated: ok {rc=0} 12:22:05.993451 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19580): Process ended prematurely: osmo-stp_10.42.42.5(pid=19580) [trial-2389↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19580)] [trial-2389↪gprs:trx-lms↪iperf3.py:8] 12:22:06.003022 tst iperf3.py:8: Test FAILED (7.6 sec) 12:22:06.030682 run osmo-hlr_10.42.42.2(pid=19577): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19577)] 12:22:06.078891 run osmo-hlr_10.42.42.2(pid=19577): stdout: | (launched: 2022-12-13_12:22:02.802740) 12:22:06.128938 run osmo-hlr_10.42.42.2(pid=19577): stderr: | 20221213122202978 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122202978 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122202979 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122202979 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122202979 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122202979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122202991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122202999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122203000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122203000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:06.179247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19572): Terminating (SIGTERM) 12:22:06.219236 run iperf3-srv_10.42.42.10(pid=19573): Terminating (SIGTERM) 12:22:06.258967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19576): Terminating (SIGTERM) 12:22:06.298837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19579): Terminating (SIGTERM) 12:22:06.338766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19582): Terminating (SIGTERM) 12:22:06.378949 --- ParallelTerminationStrategy: PID 19572 died... 12:22:06.398493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19572): Terminated: ok {rc=0} 12:22:06.442921 --- ParallelTerminationStrategy: PID 19573 died... 12:22:06.461642 run iperf3-srv_10.42.42.10(pid=19573): Terminated {rc=256} 12:22:06.505654 --- ParallelTerminationStrategy: PID 19576 died... 12:22:06.524598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19576): Terminated: ok {rc=0} 12:22:06.568771 --- ParallelTerminationStrategy: PID 19579 died... 12:22:06.587724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19579): Terminated: ok {rc=0} 12:22:06.631879 --- ParallelTerminationStrategy: PID 19582 died... 12:22:06.651271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19582): Terminated: ok {rc=0} 12:22:06.738123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms iperf3m4.py ---------------------------------------------- 12:22:07.890175 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:07.902076 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:22:07.955587 tst iperf3m4.py: using LAC 33912 12:22:08.077710 tst iperf3m4.py: using RAC 252 12:22:08.207068 tst iperf3m4.py: using CellId 33912 12:22:08.335017 tst iperf3m4.py: using BVCI 33913 12:22:08.454913 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:08.466419 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:08.477722 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:08.488827 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:08.500342 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:08.511633 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:08.523229 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:08.534636 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:08.546176 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:22:08.664421 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:22:08.791094 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:22:08.908714 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:22:09.030009 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:22:09.252941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:09.582964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19584): Launched 12:22:09.871309 run iperf3-srv_10.42.42.10(pid=19585): Launched 12:22:09.995997 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:22:10.217804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:10.547085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19586): Launched 12:22:10.834345 run iperf3-srv_10.42.42.10(pid=19587): Launched 12:22:10.959246 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:22:11.181139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:11.510555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19588): Launched 12:22:11.796091 run iperf3-srv_10.42.42.10(pid=19589): Launched 12:22:11.920431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:22:12.142726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:12.471448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19590): Launched 12:22:12.759077 run iperf3-srv_10.42.42.10(pid=19591): Launched 12:22:12.883281 tst iperf3m4.py:8: start network... 12:22:13.105453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:13.613150 run create_hlr_db(pid=19592): Launched 12:22:13.738268 bus /gobi_6: Setting Powered False 12:22:14.802788 run create_hlr_db(pid=19592): Terminated: ok {rc=0} 12:22:15.260060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19594): Launched 12:22:15.590928 run osmo-hlr_10.42.42.2(pid=19595): Launched 12:22:15.718702 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:16.313753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19597): Launched 12:22:16.641074 run osmo-stp_10.42.42.5(pid=19598): Launched 12:22:16.922913 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:17.493645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19600): Launched 12:22:17.611638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:17.872052 run patchelf(pid=19601): Launched 12:22:18.042984 run osmo-stp_10.42.42.5(pid=19598): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19598)] 12:22:18.173126 run osmo-stp_10.42.42.5(pid=19598): stdout: | (launched: 2022-12-13_12:22:16.579950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:18.304795 run osmo-stp_10.42.42.5(pid=19598): stderr: | 20221213122216807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122216808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122216808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122216808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122216809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122216809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122216809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:18.436472 run osmo-stp_10.42.42.5(pid=19598): stdout: | (launched: 2022-12-13_12:22:16.579950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:18.562169 run osmo-stp_10.42.42.5(pid=19598): stderr: | 20221213122216807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122216808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122216808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122216808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122216809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122216809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122216809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:18.710329 run patchelf(pid=19601): Terminating (SIGINT) 12:22:18.882009 run patchelf(pid=19601): Terminated: ok {rc=0} 12:22:19.006326 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19598): Process ended prematurely: osmo-stp_10.42.42.5(pid=19598) [trial-2389↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19598)] [trial-2389↪gprs:trx-lms↪iperf3m4.py:8] 12:22:19.015920 tst iperf3m4.py:8: Test FAILED (11.2 sec) 12:22:19.043481 run osmo-hlr_10.42.42.2(pid=19595): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19595)] 12:22:19.091682 run osmo-hlr_10.42.42.2(pid=19595): stdout: | (launched: 2022-12-13_12:22:15.530598) 12:22:19.141399 run osmo-hlr_10.42.42.2(pid=19595): stderr: | 20221213122215727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122215727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122215728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122215728 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122215728 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122215728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122215739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122215748 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122215748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122215748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:19.191216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19584): Terminating (SIGTERM) 12:22:19.231396 run iperf3-srv_10.42.42.10(pid=19585): Terminating (SIGTERM) 12:22:19.271115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19586): Terminating (SIGTERM) 12:22:19.310902 run iperf3-srv_10.42.42.10(pid=19587): Terminating (SIGTERM) 12:22:19.350840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19588): Terminating (SIGTERM) 12:22:19.390665 run iperf3-srv_10.42.42.10(pid=19589): Terminating (SIGTERM) 12:22:19.431061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19590): Terminating (SIGTERM) 12:22:19.470945 run iperf3-srv_10.42.42.10(pid=19591): Terminating (SIGTERM) 12:22:19.510609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19594): Terminating (SIGTERM) 12:22:19.550506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19597): Terminating (SIGTERM) 12:22:19.590240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19600): Terminating (SIGTERM) 12:22:19.630748 --- ParallelTerminationStrategy: PID 19584 died... 12:22:19.650300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19584): Terminated: ok {rc=0} 12:22:19.695081 --- ParallelTerminationStrategy: PID 19585 died... 12:22:19.714262 run iperf3-srv_10.42.42.10(pid=19585): Terminated {rc=256} 12:22:19.758878 --- ParallelTerminationStrategy: PID 19586 died... 12:22:19.778058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19586): Terminated: ok {rc=0} 12:22:19.822825 --- ParallelTerminationStrategy: PID 19587 died... 12:22:19.841839 run iperf3-srv_10.42.42.10(pid=19587): Terminated {rc=256} 12:22:19.886465 --- ParallelTerminationStrategy: PID 19588 died... 12:22:19.905578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19588): Terminated: ok {rc=0} 12:22:19.950215 --- ParallelTerminationStrategy: PID 19589 died... 12:22:19.969307 run iperf3-srv_10.42.42.10(pid=19589): Terminated {rc=256} 12:22:20.013805 --- ParallelTerminationStrategy: PID 19590 died... 12:22:20.032989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19590): Terminated: ok {rc=0} 12:22:20.077532 --- ParallelTerminationStrategy: PID 19591 died... 12:22:20.096609 run iperf3-srv_10.42.42.10(pid=19591): Terminated {rc=256} 12:22:20.141301 --- ParallelTerminationStrategy: PID 19594 died... 12:22:20.160537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19594): Terminated: ok {rc=0} 12:22:20.205127 --- ParallelTerminationStrategy: PID 19597 died... 12:22:20.224226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19597): Terminated: ok {rc=0} 12:22:20.269463 --- ParallelTerminationStrategy: PID 19600 died... 12:22:20.288717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19600): Terminated: ok {rc=0} 12:22:20.375184 bus /gobi_4: Setting Powered False 12:22:21.475688 bus /gobi_4: Setting Powered False 12:22:22.591661 bus /gobi_1: Setting Powered False 12:22:23.691642 bus /gobi_1: Setting Powered False 12:22:24.808024 bus /gobi_0: Setting Powered False 12:22:25.908049 bus /gobi_0: Setting Powered False 12:22:27.025685 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms ping.py ---------------------------------------------- 12:22:28.130299 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:28.142126 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:22:28.193246 tst ping.py: using LAC 33913 12:22:28.320033 tst ping.py: using RAC 253 12:22:28.450820 tst ping.py: using CellId 33913 12:22:28.576746 tst ping.py: using BVCI 33914 12:22:28.693871 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:28.705211 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:28.716159 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:28.727082 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:28.738940 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:28.750518 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:28.762236 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:28.773977 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:22:28.892125 tst ping.py:19: start network... 12:22:29.095357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:29.562843 run create_hlr_db(pid=19602): Launched 12:22:29.688639 bus /gobi_6: Setting Powered False 12:22:30.749586 run create_hlr_db(pid=19602): Terminated: ok {rc=0} 12:22:31.184561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19604): Launched 12:22:31.503502 run osmo-hlr_10.42.42.2(pid=19605): Launched 12:22:31.733034 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:32.438944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19607): Launched 12:22:32.740830 run osmo-stp_10.42.42.5(pid=19608): Launched 12:22:32.855643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:33.375290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19610): Launched 12:22:33.490862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:33.746535 run patchelf(pid=19611): Launched 12:22:33.914749 run osmo-stp_10.42.42.5(pid=19608): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19608)] 12:22:34.042900 run osmo-stp_10.42.42.5(pid=19608): stdout: | (launched: 2022-12-13_12:22:32.685230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:34.172305 run osmo-stp_10.42.42.5(pid=19608): stderr: | 20221213122232855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122232855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122232856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122232856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122232856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122232856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122232857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:34.302260 run osmo-stp_10.42.42.5(pid=19608): stdout: | (launched: 2022-12-13_12:22:32.685230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:34.426180 run osmo-stp_10.42.42.5(pid=19608): stderr: | 20221213122232855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122232855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122232856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122232856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122232856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122232856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122232857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:34.573652 run patchelf(pid=19611): Terminating (SIGINT) 12:22:34.742587 run patchelf(pid=19611): Terminated: ok {rc=0} 12:22:34.864750 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19608): Process ended prematurely: osmo-stp_10.42.42.5(pid=19608) [trial-2389↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19608)] [trial-2389↪gprs:trx-lms↪ping.py:22] 12:22:34.874137 tst ping.py:22: Test FAILED (6.7 sec) 12:22:34.901329 run osmo-hlr_10.42.42.2(pid=19605): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19605)] 12:22:34.949574 run osmo-hlr_10.42.42.2(pid=19605): stdout: | (launched: 2022-12-13_12:22:31.446373) 12:22:34.999659 run osmo-hlr_10.42.42.2(pid=19605): stderr: | 20221213122231779 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122231779 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122231779 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122231779 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122231779 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122231779 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122231799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122231808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122231808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122231808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:35.050228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19604): Terminating (SIGTERM) 12:22:35.090344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19607): Terminating (SIGTERM) 12:22:35.130401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19610): Terminating (SIGTERM) 12:22:35.170552 --- ParallelTerminationStrategy: PID 19604 died... 12:22:35.189986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19604): Terminated: ok {rc=0} 12:22:35.234615 --- ParallelTerminationStrategy: PID 19607 died... 12:22:35.253760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19607): Terminated: ok {rc=0} 12:22:35.298342 --- ParallelTerminationStrategy: PID 19610 died... 12:22:35.317529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19610): Terminated: ok {rc=0} 12:22:35.404461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 12:22:36.496093 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:36.508021 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:22:36.561700 tst ping_idle_ping.py: using LAC 33914 12:22:36.683426 tst ping_idle_ping.py: using RAC 254 12:22:36.804387 tst ping_idle_ping.py: using CellId 33914 12:22:36.925713 tst ping_idle_ping.py: using BVCI 33915 12:22:37.036490 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:37.047326 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:37.057907 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:37.068303 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:37.078740 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:37.089112 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:37.100123 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:22:37.110785 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:22:37.228582 tst ping_idle_ping.py:24: start network... 12:22:37.448365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:37.951632 run create_hlr_db(pid=19612): Launched 12:22:38.077767 bus /gobi_6: Setting Powered False 12:22:39.142477 run create_hlr_db(pid=19612): Terminated: ok {rc=0} 12:22:39.594471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19614): Launched 12:22:39.920820 run osmo-hlr_10.42.42.2(pid=19615): Launched 12:22:40.047894 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:40.608600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19618): Launched 12:22:40.932169 run osmo-stp_10.42.42.5(pid=19619): Launched 12:22:41.056782 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:41.615123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19621): Launched 12:22:41.741368 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:42.014177 run patchelf(pid=19622): Launched 12:22:42.183370 run osmo-stp_10.42.42.5(pid=19619): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19619)] 12:22:42.311968 run osmo-stp_10.42.42.5(pid=19619): stdout: | (launched: 2022-12-13_12:22:40.872780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:42.442252 run osmo-stp_10.42.42.5(pid=19619): stderr: | 20221213122241061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122241062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122241062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122241062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122241063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122241063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122241063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:42.572881 run osmo-stp_10.42.42.5(pid=19619): stdout: | (launched: 2022-12-13_12:22:40.872780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:42.697354 run osmo-stp_10.42.42.5(pid=19619): stderr: | 20221213122241061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122241062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122241062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122241062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122241063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122241063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122241063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:42.844129 run patchelf(pid=19622): Terminating (SIGINT) 12:22:43.013684 run patchelf(pid=19622): Terminated: ok {rc=0} 12:22:43.136481 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19619): Process ended prematurely: osmo-stp_10.42.42.5(pid=19619) [trial-2389↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19619)] [trial-2389↪gprs:trx-lms↪ping_idle_ping.py:27] 12:22:43.146042 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:22:43.173477 run osmo-hlr_10.42.42.2(pid=19615): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19615)] 12:22:43.222004 run osmo-hlr_10.42.42.2(pid=19615): stdout: | (launched: 2022-12-13_12:22:39.861533) 12:22:43.272047 run osmo-hlr_10.42.42.2(pid=19615): stderr: | 20221213122240059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122240059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122240059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122240059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122240059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122240059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122240072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122240082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122240082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122240082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:43.322441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19614): Terminating (SIGTERM) 12:22:43.363092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19618): Terminating (SIGTERM) 12:22:43.403589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19621): Terminating (SIGTERM) 12:22:43.444349 --- ParallelTerminationStrategy: PID 19614 died... 12:22:43.464016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19614): Terminated: ok {rc=0} 12:22:43.508900 --- ParallelTerminationStrategy: PID 19618 died... 12:22:43.528186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19618): Terminated: ok {rc=0} 12:22:43.572682 --- ParallelTerminationStrategy: PID 19621 died... 12:22:43.591867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19621): Terminated: ok {rc=0} 12:22:43.680115 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 12:22:44.981235 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:22:44.986979 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:22:45.020394 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:22:45.059661 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:22:45.146658 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:22:45.180012 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:22:45.218744 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:22:45.810824 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:22:45.863961 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:45.880513 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:22:45.939921 tst cs_paging_gprs_active.py: using LAC 33915 12:22:46.061478 tst cs_paging_gprs_active.py: using RAC 255 12:22:46.185221 tst cs_paging_gprs_active.py: using CellId 33915 12:22:46.317651 tst cs_paging_gprs_active.py: using BVCI 33916 12:22:46.444607 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:46.457732 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:46.470338 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:46.483041 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:46.496941 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:46.510672 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:46.525705 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:46.540256 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:46.552865 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:22:46.716098 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:22:46.849455 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:22:47.081718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:47.398533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19626): Launched 12:22:47.670366 run iperf3-srv_10.42.42.10(pid=19627): Launched 12:22:47.786661 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:22:47.993162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:48.303124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19628): Launched 12:22:48.573155 run iperf3-srv_10.42.42.10(pid=19629): Launched 12:22:48.689196 tst cs_paging_gprs_active.py:38: start network... 12:22:48.895579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:49.372322 run create_hlr_db(pid=19630): Launched 12:22:49.498082 bus /gobi_6: Setting Powered False 12:22:50.559562 run create_hlr_db(pid=19630): Terminated: ok {rc=0} 12:22:51.009866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19632): Launched 12:22:51.339642 run osmo-hlr_10.42.42.2(pid=19633): Launched 12:22:51.465796 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:52.034417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19635): Launched 12:22:52.365196 run osmo-stp_10.42.42.5(pid=19636): Launched 12:22:52.490533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:53.059573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19638): Launched 12:22:53.185865 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:53.464059 run patchelf(pid=19639): Launched 12:22:53.649102 run osmo-stp_10.42.42.5(pid=19636): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19636)] 12:22:53.788608 run osmo-stp_10.42.42.5(pid=19636): stdout: | (launched: 2022-12-13_12:22:52.304644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:53.929953 run osmo-stp_10.42.42.5(pid=19636): stderr: | 20221213122252496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122252496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122252497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122252497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122252498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122252498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122252498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:54.071897 run osmo-stp_10.42.42.5(pid=19636): stdout: | (launched: 2022-12-13_12:22:52.304644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:54.207025 run osmo-stp_10.42.42.5(pid=19636): stderr: | 20221213122252496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122252496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122252497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122252497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122252498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122252498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122252498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:54.366817 run patchelf(pid=19639): Terminating (SIGINT) 12:22:54.551181 run patchelf(pid=19639): Terminated: ok {rc=0} 12:22:54.683422 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19636): Process ended prematurely: osmo-stp_10.42.42.5(pid=19636) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19636)] [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:22:54.693988 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:22:54.722694 run osmo-hlr_10.42.42.2(pid=19633): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19633)] 12:22:54.774464 run osmo-hlr_10.42.42.2(pid=19633): stdout: | (launched: 2022-12-13_12:22:51.279461) 12:22:54.826985 run osmo-hlr_10.42.42.2(pid=19633): stderr: | 20221213122251476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122251476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122251476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122251476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122251476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122251476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122251489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122251498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122251498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122251498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:54.879822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19626): Terminating (SIGTERM) 12:22:54.921976 run iperf3-srv_10.42.42.10(pid=19627): Terminating (SIGTERM) 12:22:54.964643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19628): Terminating (SIGTERM) 12:22:55.007487 run iperf3-srv_10.42.42.10(pid=19629): Terminating (SIGTERM) 12:22:55.049857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19632): Terminating (SIGTERM) 12:22:55.092356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19635): Terminating (SIGTERM) 12:22:55.135070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19638): Terminating (SIGTERM) 12:22:55.177821 --- ParallelTerminationStrategy: PID 19626 died... 12:22:55.198440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19626): Terminated: ok {rc=0} 12:22:55.245759 --- ParallelTerminationStrategy: PID 19627 died... 12:22:55.266085 run iperf3-srv_10.42.42.10(pid=19627): Terminated {rc=256} 12:22:55.313141 --- ParallelTerminationStrategy: PID 19628 died... 12:22:55.333395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19628): Terminated: ok {rc=0} 12:22:55.380325 --- ParallelTerminationStrategy: PID 19629 died... 12:22:55.400597 run iperf3-srv_10.42.42.10(pid=19629): Terminated {rc=256} 12:22:55.447521 --- ParallelTerminationStrategy: PID 19632 died... 12:22:55.467781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19632): Terminated: ok {rc=0} 12:22:55.514936 --- ParallelTerminationStrategy: PID 19635 died... 12:22:55.535412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19635): Terminated: ok {rc=0} 12:22:55.582271 --- ParallelTerminationStrategy: PID 19638 died... 12:22:55.602464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19638): Terminated: ok {rc=0} 12:22:55.693651 bus /gobi_0: Setting Powered False 12:22:56.793910 bus /gobi_0: Setting Powered False 12:22:57.910309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:22:59.063008 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:59.075258 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:22:59.129142 tst iperf3.py: using LAC 33916 12:22:59.259795 tst iperf3.py: using RAC 1 12:22:59.390741 tst iperf3.py: using CellId 33916 12:22:59.521274 tst iperf3.py: using BVCI 33917 12:22:59.642226 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:59.653705 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:59.664892 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:59.676203 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:59.687886 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:59.699535 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:59.711368 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:59.723074 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:59.734993 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:22:59.855677 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:23:00.079033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:00.409373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19640): Launched 12:23:00.697479 run iperf3-srv_10.42.42.10(pid=19641): Launched 12:23:00.829271 tst iperf3.py:8: start network... 12:23:01.098834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:01.664406 run create_hlr_db(pid=19642): Launched 12:23:01.810483 bus /gobi_6: Setting Powered False 12:23:02.876182 run create_hlr_db(pid=19642): Terminated: ok {rc=0} 12:23:03.326208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19644): Launched 12:23:03.635691 run osmo-hlr_10.42.42.2(pid=19645): Launched 12:23:03.752648 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:04.283465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19647): Launched 12:23:04.591718 run osmo-stp_10.42.42.5(pid=19648): Launched 12:23:04.707772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:05.235460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19650): Launched 12:23:05.353381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:05.612048 run patchelf(pid=19651): Launched 12:23:05.783957 run osmo-stp_10.42.42.5(pid=19648): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19648)] 12:23:05.914736 run osmo-stp_10.42.42.5(pid=19648): stdout: | (launched: 2022-12-13_12:23:04.535177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:06.046546 run osmo-stp_10.42.42.5(pid=19648): stderr: | 20221213122304706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122304706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122304706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122304707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122304707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122304707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122304708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:06.178433 run osmo-stp_10.42.42.5(pid=19648): stdout: | (launched: 2022-12-13_12:23:04.535177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:06.304298 run osmo-stp_10.42.42.5(pid=19648): stderr: | 20221213122304706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122304706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122304706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122304707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122304707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122304707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122304708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:06.453738 run patchelf(pid=19651): Terminating (SIGINT) 12:23:06.626099 run patchelf(pid=19651): Terminated: ok {rc=0} 12:23:06.750409 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19648): Process ended prematurely: osmo-stp_10.42.42.5(pid=19648) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19648)] [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 12:23:06.760125 tst iperf3.py:8: Test FAILED (7.7 sec) 12:23:06.787661 run osmo-hlr_10.42.42.2(pid=19645): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19645)] 12:23:06.835755 run osmo-hlr_10.42.42.2(pid=19645): stdout: | (launched: 2022-12-13_12:23:03.578895) 12:23:06.885629 run osmo-hlr_10.42.42.2(pid=19645): stderr: | 20221213122303757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122303757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122303757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122303757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122303757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122303757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122303769 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122303780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122303780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122303780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:06.935827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19640): Terminating (SIGTERM) 12:23:06.975987 run iperf3-srv_10.42.42.10(pid=19641): Terminating (SIGTERM) 12:23:07.016006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19644): Terminating (SIGTERM) 12:23:07.056348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19647): Terminating (SIGTERM) 12:23:07.096601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19650): Terminating (SIGTERM) 12:23:07.137329 --- ParallelTerminationStrategy: PID 19640 died... 12:23:07.156887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19640): Terminated: ok {rc=0} 12:23:07.201453 --- ParallelTerminationStrategy: PID 19641 died... 12:23:07.220277 run iperf3-srv_10.42.42.10(pid=19641): Terminated {rc=256} 12:23:07.264638 --- ParallelTerminationStrategy: PID 19644 died... 12:23:07.283632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19644): Terminated: ok {rc=0} 12:23:07.328611 --- ParallelTerminationStrategy: PID 19647 died... 12:23:07.347649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19647): Terminated: ok {rc=0} 12:23:07.392037 --- ParallelTerminationStrategy: PID 19650 died... 12:23:07.410981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19650): Terminated: ok {rc=0} 12:23:07.498574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:23:08.648559 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:08.660159 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:08.712421 tst iperf3m4.py: using LAC 33917 12:23:08.835614 tst iperf3m4.py: using RAC 2 12:23:08.958018 tst iperf3m4.py: using CellId 33917 12:23:09.078222 tst iperf3m4.py: using BVCI 33918 12:23:09.191066 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:09.202073 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:09.212736 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:09.223442 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:09.234098 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:09.244663 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:09.256004 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:09.266841 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:09.277810 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:09.399348 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:09.518232 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:09.640075 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:09.757840 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:23:09.967716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:10.278886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19652): Launched 12:23:10.548765 run iperf3-srv_10.42.42.10(pid=19653): Launched 12:23:10.664424 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:23:10.870754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:11.179328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19654): Launched 12:23:11.449024 run iperf3-srv_10.42.42.10(pid=19655): Launched 12:23:11.564184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:23:11.770701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:12.080820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19656): Launched 12:23:12.349368 run iperf3-srv_10.42.42.10(pid=19657): Launched 12:23:12.464589 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:23:12.671095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:12.980201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19658): Launched 12:23:13.249790 run iperf3-srv_10.42.42.10(pid=19659): Launched 12:23:13.372338 tst iperf3m4.py:8: start network... 12:23:13.579017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:14.056532 run create_hlr_db(pid=19660): Launched 12:23:14.181853 bus /gobi_6: Setting Powered False 12:23:15.243587 run create_hlr_db(pid=19660): Terminated: ok {rc=0} 12:23:15.693161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19662): Launched 12:23:16.034566 run osmo-hlr_10.42.42.2(pid=19663): Launched 12:23:16.282763 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:16.936611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19665): Launched 12:23:17.281561 run osmo-stp_10.42.42.5(pid=19666): Launched 12:23:17.410369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:17.976815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19668): Launched 12:23:18.102995 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:18.380051 run patchelf(pid=19669): Launched 12:23:18.572765 run osmo-stp_10.42.42.5(pid=19666): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19666)] 12:23:18.711903 run osmo-stp_10.42.42.5(pid=19666): stdout: | (launched: 2022-12-13_12:23:17.221189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:18.852244 run osmo-stp_10.42.42.5(pid=19666): stderr: | 20221213122317410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122317410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122317410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122317411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122317411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122317411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122317411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:18.993291 run osmo-stp_10.42.42.5(pid=19666): stdout: | (launched: 2022-12-13_12:23:17.221189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:19.127675 run osmo-stp_10.42.42.5(pid=19666): stderr: | 20221213122317410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122317410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122317410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122317411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122317411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122317411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122317411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:19.287554 run patchelf(pid=19669): Terminating (SIGINT) 12:23:19.471512 run patchelf(pid=19669): Terminated: ok {rc=0} 12:23:19.604463 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19666): Process ended prematurely: osmo-stp_10.42.42.5(pid=19666) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19666)] [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 12:23:19.614868 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:23:19.643861 run osmo-hlr_10.42.42.2(pid=19663): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19663)] 12:23:19.694884 run osmo-hlr_10.42.42.2(pid=19663): stdout: | (launched: 2022-12-13_12:23:15.974266) 12:23:19.747563 run osmo-hlr_10.42.42.2(pid=19663): stderr: | 20221213122316279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122316279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122316279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122316279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122316279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122316279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122316295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122316307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122316308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122316308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:19.800337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19652): Terminating (SIGTERM) 12:23:19.842533 run iperf3-srv_10.42.42.10(pid=19653): Terminating (SIGTERM) 12:23:19.884870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19654): Terminating (SIGTERM) 12:23:19.928299 run iperf3-srv_10.42.42.10(pid=19655): Terminating (SIGTERM) 12:23:19.971473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19656): Terminating (SIGTERM) 12:23:20.014060 run iperf3-srv_10.42.42.10(pid=19657): Terminating (SIGTERM) 12:23:20.056301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19658): Terminating (SIGTERM) 12:23:20.098759 run iperf3-srv_10.42.42.10(pid=19659): Terminating (SIGTERM) 12:23:20.140919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19662): Terminating (SIGTERM) 12:23:20.183505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19665): Terminating (SIGTERM) 12:23:20.225831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19668): Terminating (SIGTERM) 12:23:20.268293 --- ParallelTerminationStrategy: PID 19652 died... 12:23:20.288917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19652): Terminated: ok {rc=0} 12:23:20.335899 --- ParallelTerminationStrategy: PID 19653 died... 12:23:20.355908 run iperf3-srv_10.42.42.10(pid=19653): Terminated {rc=256} 12:23:20.402810 --- ParallelTerminationStrategy: PID 19654 died... 12:23:20.422849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19654): Terminated: ok {rc=0} 12:23:20.469521 --- ParallelTerminationStrategy: PID 19655 died... 12:23:20.489432 run iperf3-srv_10.42.42.10(pid=19655): Terminated {rc=256} 12:23:20.535982 --- ParallelTerminationStrategy: PID 19656 died... 12:23:20.556014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19656): Terminated: ok {rc=0} 12:23:20.602605 --- ParallelTerminationStrategy: PID 19657 died... 12:23:20.622557 run iperf3-srv_10.42.42.10(pid=19657): Terminated {rc=256} 12:23:20.669189 --- ParallelTerminationStrategy: PID 19658 died... 12:23:20.689205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19658): Terminated: ok {rc=0} 12:23:20.736019 --- ParallelTerminationStrategy: PID 19659 died... 12:23:20.755996 run iperf3-srv_10.42.42.10(pid=19659): Terminated {rc=256} 12:23:20.802570 --- ParallelTerminationStrategy: PID 19662 died... 12:23:20.822751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19662): Terminated: ok {rc=0} 12:23:20.869585 --- ParallelTerminationStrategy: PID 19665 died... 12:23:20.889610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19665): Terminated: ok {rc=0} 12:23:20.936511 --- ParallelTerminationStrategy: PID 19668 died... 12:23:20.957188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19668): Terminated: ok {rc=0} 12:23:21.046371 bus /gobi_4: Setting Powered False 12:23:22.147362 bus /gobi_4: Setting Powered False 12:23:23.266239 bus /gobi_1: Setting Powered False 12:23:24.363589 bus /gobi_1: Setting Powered False 12:23:25.481114 bus /gobi_0: Setting Powered False 12:23:26.581753 bus /gobi_0: Setting Powered False 12:23:27.698231 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 12:23:28.802710 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:28.814697 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:28.867567 tst ping.py: using LAC 33918 12:23:28.994246 tst ping.py: using RAC 3 12:23:29.122537 tst ping.py: using CellId 33918 12:23:29.251395 tst ping.py: using BVCI 33919 12:23:29.369076 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:29.380460 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:29.391620 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:29.402922 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:29.414488 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:29.425952 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:29.437637 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:29.449095 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:29.569145 tst ping.py:19: start network... 12:23:29.787249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:30.286650 run create_hlr_db(pid=19670): Launched 12:23:30.411324 bus /gobi_6: Setting Powered False 12:23:31.473918 run create_hlr_db(pid=19670): Terminated: ok {rc=0} 12:23:32.004414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19672): Launched 12:23:32.345025 run osmo-hlr_10.42.42.2(pid=19673): Launched 12:23:32.469529 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:33.028871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19675): Launched 12:23:33.352537 run osmo-stp_10.42.42.5(pid=19676): Launched 12:23:33.477297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:34.034483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19678): Launched 12:23:34.159765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:34.431972 run patchelf(pid=19679): Launched 12:23:34.611143 run osmo-stp_10.42.42.5(pid=19676): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19676)] 12:23:34.747601 run osmo-stp_10.42.42.5(pid=19676): stdout: | (launched: 2022-12-13_12:23:33.293427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:34.886206 run osmo-stp_10.42.42.5(pid=19676): stderr: | 20221213122333484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122333484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122333484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122333485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122333485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122333485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122333485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:35.025484 run osmo-stp_10.42.42.5(pid=19676): stdout: | (launched: 2022-12-13_12:23:33.293427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:35.157755 run osmo-stp_10.42.42.5(pid=19676): stderr: | 20221213122333484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122333484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122333484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122333485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122333485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122333485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122333485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:35.314767 run patchelf(pid=19679): Terminating (SIGINT) 12:23:35.495051 run patchelf(pid=19679): Terminated: ok {rc=0} 12:23:35.625060 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19676): Process ended prematurely: osmo-stp_10.42.42.5(pid=19676) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19676)] [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 12:23:35.634887 tst ping.py:22: Test FAILED (6.8 sec) 12:23:35.663118 run osmo-hlr_10.42.42.2(pid=19673): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19673)] 12:23:35.713945 run osmo-hlr_10.42.42.2(pid=19673): stdout: | (launched: 2022-12-13_12:23:32.285793) 12:23:35.766519 run osmo-hlr_10.42.42.2(pid=19673): stderr: | 20221213122332481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122332481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122332481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122332481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122332482 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122332482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122332494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122332503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122332503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122332503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:35.819154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19672): Terminating (SIGTERM) 12:23:35.861066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19675): Terminating (SIGTERM) 12:23:35.903239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19678): Terminating (SIGTERM) 12:23:35.945837 --- ParallelTerminationStrategy: PID 19672 died... 12:23:35.966669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19672): Terminated: ok {rc=0} 12:23:36.014207 --- ParallelTerminationStrategy: PID 19675 died... 12:23:36.034389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19675): Terminated: ok {rc=0} 12:23:36.081271 --- ParallelTerminationStrategy: PID 19678 died... 12:23:36.101414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19678): Terminated: ok {rc=0} 12:23:36.190589 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:23:37.278186 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:37.290361 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:37.344333 tst ping_idle_ping.py: using LAC 33919 12:23:37.470868 tst ping_idle_ping.py: using RAC 4 12:23:37.599067 tst ping_idle_ping.py: using CellId 33919 12:23:37.726754 tst ping_idle_ping.py: using BVCI 33920 12:23:37.843855 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:37.855350 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:37.866619 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:37.878005 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:37.889491 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:37.901049 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:37.912721 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:37.924288 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:38.039955 tst ping_idle_ping.py:24: start network... 12:23:38.243345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:38.713369 run create_hlr_db(pid=19680): Launched 12:23:38.839218 bus /gobi_6: Setting Powered False 12:23:39.899731 run create_hlr_db(pid=19680): Terminated: ok {rc=0} 12:23:40.325060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19682): Launched 12:23:40.627448 run osmo-hlr_10.42.42.2(pid=19683): Launched 12:23:40.742012 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:41.277717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19685): Launched 12:23:41.582368 run osmo-stp_10.42.42.5(pid=19686): Launched 12:23:41.699554 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:42.222355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19688): Launched 12:23:42.339761 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:42.595086 run patchelf(pid=19689): Launched 12:23:42.763182 run osmo-stp_10.42.42.5(pid=19686): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19686)] 12:23:42.890975 run osmo-stp_10.42.42.5(pid=19686): stdout: | (launched: 2022-12-13_12:23:41.526004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:43.020526 run osmo-stp_10.42.42.5(pid=19686): stderr: | 20221213122341697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122341697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122341697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122341698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122341698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122341698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122341698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:43.150429 run osmo-stp_10.42.42.5(pid=19686): stdout: | (launched: 2022-12-13_12:23:41.526004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:43.273938 run osmo-stp_10.42.42.5(pid=19686): stderr: | 20221213122341697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122341697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122341697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122341698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122341698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122341698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122341698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:43.420381 run patchelf(pid=19689): Terminating (SIGINT) 12:23:43.589492 run patchelf(pid=19689): Terminated: ok {rc=0} 12:23:43.711155 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19686): Process ended prematurely: osmo-stp_10.42.42.5(pid=19686) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19686)] [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 12:23:43.720202 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 12:23:43.747204 run osmo-hlr_10.42.42.2(pid=19683): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19683)] 12:23:43.794837 run osmo-hlr_10.42.42.2(pid=19683): stdout: | (launched: 2022-12-13_12:23:40.571682) 12:23:43.844307 run osmo-hlr_10.42.42.2(pid=19683): stderr: | 20221213122340749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122340749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122340749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122340749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122340749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122340749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122340761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122340770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122340770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122340770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:43.894170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19682): Terminating (SIGTERM) 12:23:43.934433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19685): Terminating (SIGTERM) 12:23:43.974134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19688): Terminating (SIGTERM) 12:23:44.014597 --- ParallelTerminationStrategy: PID 19682 died... 12:23:44.034258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19682): Terminated: ok {rc=0} 12:23:44.079365 --- ParallelTerminationStrategy: PID 19685 died... 12:23:44.098831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19685): Terminated: ok {rc=0} 12:23:44.143450 --- ParallelTerminationStrategy: PID 19688 died... 12:23:44.162549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19688): Terminated: ok {rc=0} 12:23:44.249581 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:23:45.554532 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:23:45.560516 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:23:45.593752 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:23:45.632500 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:23:45.723542 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:23:45.758559 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:23:45.796697 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:23:46.422738 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:23:46.475380 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:46.487180 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:23:46.557639 tst cs_paging_gprs_active.py: using LAC 33920 12:23:46.690367 tst cs_paging_gprs_active.py: using RAC 5 12:23:46.874573 tst cs_paging_gprs_active.py: using CellId 33920 12:23:47.068422 tst cs_paging_gprs_active.py: using BVCI 33921 12:23:47.236179 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:47.255079 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:47.269518 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:47.285283 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:47.299333 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:47.313929 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:47.331175 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:47.347618 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:47.366855 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:23:47.519544 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:23:47.647203 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:23:47.896692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:48.297700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19770): Launched 12:23:48.651971 run iperf3-srv_10.42.42.10(pid=19800): Launched 12:23:48.827593 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:23:49.105153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:49.510450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19913): Launched 12:23:49.880507 run iperf3-srv_10.42.42.10(pid=19964): Launched 12:23:50.061468 tst cs_paging_gprs_active.py:38: start network... 12:23:50.291236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:50.781036 run create_hlr_db(pid=19977): Launched 12:23:50.942300 bus /gobi_6: Setting Powered False 12:23:52.004444 run create_hlr_db(pid=19977): Terminated: ok {rc=0} 12:23:52.447981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19981): Launched 12:23:52.779030 run osmo-hlr_10.42.42.2(pid=19982): Launched 12:23:53.019025 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:53.721588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19984): Launched 12:23:54.063547 run osmo-stp_10.42.42.5(pid=19985): Launched 12:23:54.313474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:54.957270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19987): Launched 12:23:55.096021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:55.387364 run patchelf(pid=19988): Launched 12:23:55.588750 run osmo-stp_10.42.42.5(pid=19985): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19985)] 12:23:55.732438 run osmo-stp_10.42.42.5(pid=19985): stdout: | (launched: 2022-12-13_12:23:54.003592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:55.878356 run osmo-stp_10.42.42.5(pid=19985): stderr: | 20221213122354290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122354290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122354290 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122354290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122354291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122354291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122354291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:56.025308 run osmo-stp_10.42.42.5(pid=19985): stdout: | (launched: 2022-12-13_12:23:54.003592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:56.164127 run osmo-stp_10.42.42.5(pid=19985): stderr: | 20221213122354290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122354290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122354290 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122354290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122354291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122354291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122354291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:56.329152 run patchelf(pid=19988): Terminating (SIGINT) 12:23:56.519535 run patchelf(pid=19988): Terminated: ok {rc=0} 12:23:56.657221 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19985): Process ended prematurely: osmo-stp_10.42.42.5(pid=19985) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19985)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:23:56.668760 tst cs_paging_gprs_active.py:38: Test FAILED (10.2 sec) 12:23:56.699301 run osmo-hlr_10.42.42.2(pid=19982): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19982)] 12:23:56.754205 run osmo-hlr_10.42.42.2(pid=19982): stdout: | (launched: 2022-12-13_12:23:52.719831) 12:23:56.809119 run osmo-hlr_10.42.42.2(pid=19982): stderr: | 20221213122353049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122353049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122353049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122353049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122353049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122353049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122353067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122353075 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122353075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122353075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:56.864426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19770): Terminating (SIGTERM) 12:23:56.908251 run iperf3-srv_10.42.42.10(pid=19800): Terminating (SIGTERM) 12:23:56.956194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19913): Terminating (SIGTERM) 12:23:57.002030 run iperf3-srv_10.42.42.10(pid=19964): Terminating (SIGTERM) 12:23:57.049735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19981): Terminating (SIGTERM) 12:23:57.095207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19984): Terminating (SIGTERM) 12:23:57.141920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19987): Terminating (SIGTERM) 12:23:57.189181 --- ParallelTerminationStrategy: PID 19770 died... 12:23:57.211487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19770): Terminated: ok {rc=0} 12:23:57.261929 --- ParallelTerminationStrategy: PID 19800 died... 12:23:57.283630 run iperf3-srv_10.42.42.10(pid=19800): Terminated {rc=256} 12:23:57.332551 --- ParallelTerminationStrategy: PID 19913 died... 12:23:57.354594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19913): Terminated: ok {rc=0} 12:23:57.403635 --- ParallelTerminationStrategy: PID 19964 died... 12:23:57.425629 run iperf3-srv_10.42.42.10(pid=19964): Terminated {rc=256} 12:23:57.474772 --- ParallelTerminationStrategy: PID 19981 died... 12:23:57.496709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19981): Terminated: ok {rc=0} 12:23:57.545613 --- ParallelTerminationStrategy: PID 19984 died... 12:23:57.567518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19984): Terminated: ok {rc=0} 12:23:57.616523 --- ParallelTerminationStrategy: PID 19987 died... 12:23:57.638130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19987): Terminated: ok {rc=0} 12:23:57.730998 bus /gobi_0: Setting Powered False 12:23:58.834551 bus /gobi_0: Setting Powered False 12:23:59.956014 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:24:01.158561 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:01.174941 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:01.263058 tst iperf3.py: using LAC 33921 12:24:01.423425 tst iperf3.py: using RAC 6 12:24:01.556291 tst iperf3.py: using CellId 33921 12:24:01.715227 tst iperf3.py: using BVCI 33922 12:24:01.848267 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:01.860250 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:01.871728 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:01.883546 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:01.896212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:01.909609 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:01.923110 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:01.936398 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:01.949451 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:02.098883 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:24:02.327725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:02.664890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19989): Launched 12:24:03.010138 run iperf3-srv_10.42.42.10(pid=19990): Launched 12:24:03.149904 tst iperf3.py:8: start network... 12:24:03.377655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:03.897094 run create_hlr_db(pid=19991): Launched 12:24:04.057858 bus /gobi_6: Setting Powered False 12:24:05.123755 run create_hlr_db(pid=19991): Terminated: ok {rc=0} 12:24:05.596712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19993): Launched 12:24:05.947717 run osmo-hlr_10.42.42.2(pid=19994): Launched 12:24:06.204490 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:06.885869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19996): Launched 12:24:07.237552 run osmo-stp_10.42.42.5(pid=19997): Launched 12:24:07.490964 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:08.155150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19999): Launched 12:24:08.296587 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:08.585703 run patchelf(pid=20000): Launched 12:24:08.788703 run osmo-stp_10.42.42.5(pid=19997): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19997)] 12:24:08.933777 run osmo-stp_10.42.42.5(pid=19997): stdout: | (launched: 2022-12-13_12:24:07.176096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:09.082152 run osmo-stp_10.42.42.5(pid=19997): stderr: | 20221213122407475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122407475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122407475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122407476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122407476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122407476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122407476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:09.230936 run osmo-stp_10.42.42.5(pid=19997): stdout: | (launched: 2022-12-13_12:24:07.176096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:09.371561 run osmo-stp_10.42.42.5(pid=19997): stderr: | 20221213122407475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122407475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122407475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122407476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122407476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122407476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122407476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:09.540016 run patchelf(pid=20000): Terminating (SIGINT) 12:24:09.730737 run patchelf(pid=20000): Terminated: ok {rc=0} 12:24:09.870275 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19997): Process ended prematurely: osmo-stp_10.42.42.5(pid=19997) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19997)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 12:24:09.882420 tst iperf3.py:8: Test FAILED (8.8 sec) 12:24:09.914159 run osmo-hlr_10.42.42.2(pid=19994): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19994)] 12:24:09.969744 run osmo-hlr_10.42.42.2(pid=19994): stdout: | (launched: 2022-12-13_12:24:05.886074) 12:24:10.026545 run osmo-hlr_10.42.42.2(pid=19994): stderr: | 20221213122406197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122406197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122406197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122406197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122406197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122406197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122406211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122406219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122406219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122406219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:10.083095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19989): Terminating (SIGTERM) 12:24:10.127659 run iperf3-srv_10.42.42.10(pid=19990): Terminating (SIGTERM) 12:24:10.176828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19993): Terminating (SIGTERM) 12:24:10.223505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19996): Terminating (SIGTERM) 12:24:10.271499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19999): Terminating (SIGTERM) 12:24:10.319799 --- ParallelTerminationStrategy: PID 19989 died... 12:24:10.343770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19989): Terminated: ok {rc=0} 12:24:10.396308 --- ParallelTerminationStrategy: PID 19990 died... 12:24:10.417755 run iperf3-srv_10.42.42.10(pid=19990): Terminated {rc=256} 12:24:10.467769 --- ParallelTerminationStrategy: PID 19993 died... 12:24:10.489462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19993): Terminated: ok {rc=0} 12:24:10.541276 --- ParallelTerminationStrategy: PID 19996 died... 12:24:10.562641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19996): Terminated: ok {rc=0} 12:24:10.620790 --- ParallelTerminationStrategy: PID 19999 died... 12:24:10.641176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19999): Terminated: ok {rc=0} 12:24:10.730404 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:24:11.884755 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:11.896924 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:11.974971 tst iperf3m4.py: using LAC 33922 12:24:12.102767 tst iperf3m4.py: using RAC 7 12:24:12.229479 tst iperf3m4.py: using CellId 33922 12:24:12.352537 tst iperf3m4.py: using BVCI 33923 12:24:12.463917 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:12.475137 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:12.485958 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:12.497035 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:12.507865 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:12.518680 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:12.529563 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:12.540222 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:12.551188 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:12.672479 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:12.796877 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:12.916178 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:13.034878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:24:13.244541 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:13.555617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20002): Launched 12:24:13.825840 run iperf3-srv_10.42.42.10(pid=20003): Launched 12:24:13.942133 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:24:14.150320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:14.462948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20004): Launched 12:24:14.735789 run iperf3-srv_10.42.42.10(pid=20005): Launched 12:24:14.851191 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:24:15.058308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:15.368234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20006): Launched 12:24:15.636734 run iperf3-srv_10.42.42.10(pid=20007): Launched 12:24:15.751654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:24:15.987654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:16.348721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20008): Launched 12:24:16.663198 run iperf3-srv_10.42.42.10(pid=20009): Launched 12:24:16.797725 tst iperf3m4.py:8: start network... 12:24:17.030668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:17.549695 run create_hlr_db(pid=20010): Launched 12:24:17.676537 bus /gobi_6: Setting Powered False 12:24:18.738317 run create_hlr_db(pid=20010): Terminated: ok {rc=0} 12:24:19.186520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20012): Launched 12:24:19.514570 run osmo-hlr_10.42.42.2(pid=20013): Launched 12:24:19.642006 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:20.212908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20015): Launched 12:24:20.542934 run osmo-stp_10.42.42.5(pid=20016): Launched 12:24:20.669815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:21.236737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20018): Launched 12:24:21.363686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:21.640314 run patchelf(pid=20019): Launched 12:24:21.824022 run osmo-stp_10.42.42.5(pid=20016): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20016)] 12:24:21.963556 run osmo-stp_10.42.42.5(pid=20016): stdout: | (launched: 2022-12-13_12:24:20.482833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:22.104494 run osmo-stp_10.42.42.5(pid=20016): stderr: | 20221213122420672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122420672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122420672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122420672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122420673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122420673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122420673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:22.245198 run osmo-stp_10.42.42.5(pid=20016): stdout: | (launched: 2022-12-13_12:24:20.482833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:22.379725 run osmo-stp_10.42.42.5(pid=20016): stderr: | 20221213122420672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122420672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122420672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122420672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122420673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122420673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122420673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:22.539161 run patchelf(pid=20019): Terminating (SIGINT) 12:24:22.722844 run patchelf(pid=20019): Terminated: ok {rc=0} 12:24:22.855061 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20016): Process ended prematurely: osmo-stp_10.42.42.5(pid=20016) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20016)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:24:22.865511 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:24:22.894740 run osmo-hlr_10.42.42.2(pid=20013): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20013)] 12:24:22.945853 run osmo-hlr_10.42.42.2(pid=20013): stdout: | (launched: 2022-12-13_12:24:19.454393) 12:24:22.999118 run osmo-hlr_10.42.42.2(pid=20013): stderr: | 20221213122419652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122419652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122419652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122419652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122419652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122419652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122419664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122419673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122419673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122419673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:23.052118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20002): Terminating (SIGTERM) 12:24:23.094653 run iperf3-srv_10.42.42.10(pid=20003): Terminating (SIGTERM) 12:24:23.138277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20004): Terminating (SIGTERM) 12:24:23.181672 run iperf3-srv_10.42.42.10(pid=20005): Terminating (SIGTERM) 12:24:23.222589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20006): Terminating (SIGTERM) 12:24:23.263147 run iperf3-srv_10.42.42.10(pid=20007): Terminating (SIGTERM) 12:24:23.303482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20008): Terminating (SIGTERM) 12:24:23.343978 run iperf3-srv_10.42.42.10(pid=20009): Terminating (SIGTERM) 12:24:23.384340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20012): Terminating (SIGTERM) 12:24:23.424778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20015): Terminating (SIGTERM) 12:24:23.465367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20018): Terminating (SIGTERM) 12:24:23.506229 --- ParallelTerminationStrategy: PID 20002 died... 12:24:23.526109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20002): Terminated: ok {rc=0} 12:24:23.571061 --- ParallelTerminationStrategy: PID 20003 died... 12:24:23.590564 run iperf3-srv_10.42.42.10(pid=20003): Terminated {rc=256} 12:24:23.635417 --- ParallelTerminationStrategy: PID 20004 died... 12:24:23.654836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20004): Terminated: ok {rc=0} 12:24:23.699501 --- ParallelTerminationStrategy: PID 20005 died... 12:24:23.718800 run iperf3-srv_10.42.42.10(pid=20005): Terminated {rc=256} 12:24:23.763364 --- ParallelTerminationStrategy: PID 20006 died... 12:24:23.782811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20006): Terminated: ok {rc=0} 12:24:23.827691 --- ParallelTerminationStrategy: PID 20007 died... 12:24:23.847045 run iperf3-srv_10.42.42.10(pid=20007): Terminated {rc=256} 12:24:23.891727 --- ParallelTerminationStrategy: PID 20008 died... 12:24:23.911099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20008): Terminated: ok {rc=0} 12:24:23.955845 --- ParallelTerminationStrategy: PID 20009 died... 12:24:23.975214 run iperf3-srv_10.42.42.10(pid=20009): Terminated {rc=256} 12:24:24.019965 --- ParallelTerminationStrategy: PID 20012 died... 12:24:24.039348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20012): Terminated: ok {rc=0} 12:24:24.084207 --- ParallelTerminationStrategy: PID 20015 died... 12:24:24.103610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20015): Terminated: ok {rc=0} 12:24:24.148346 --- ParallelTerminationStrategy: PID 20018 died... 12:24:24.167851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20018): Terminated: ok {rc=0} 12:24:24.256119 bus /gobi_4: Setting Powered False 12:24:25.356692 bus /gobi_4: Setting Powered False 12:24:26.474096 bus /gobi_1: Setting Powered False 12:24:27.574988 bus /gobi_1: Setting Powered False 12:24:28.692295 bus /gobi_0: Setting Powered False 12:24:29.788868 bus /gobi_0: Setting Powered False 12:24:30.920114 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:24:32.034709 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:32.048048 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:32.124828 tst ping.py: using LAC 33923 12:24:32.251767 tst ping.py: using RAC 8 12:24:32.368510 tst ping.py: using CellId 33923 12:24:32.485192 tst ping.py: using BVCI 33924 12:24:32.594530 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:32.605535 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:32.616184 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:32.626937 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:32.637570 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:32.648247 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:32.659030 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:32.669778 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:32.783894 tst ping.py:19: start network... 12:24:32.986066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:33.452600 run create_hlr_db(pid=20020): Launched 12:24:33.576006 bus /gobi_6: Setting Powered False 12:24:34.636153 run create_hlr_db(pid=20020): Terminated: ok {rc=0} 12:24:35.078048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20022): Launched 12:24:35.402350 run osmo-hlr_10.42.42.2(pid=20023): Launched 12:24:35.527167 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:36.087272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20025): Launched 12:24:36.411327 run osmo-stp_10.42.42.5(pid=20026): Launched 12:24:36.534600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:37.091361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20028): Launched 12:24:37.216668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:37.489564 run patchelf(pid=20029): Launched 12:24:37.670635 run osmo-stp_10.42.42.5(pid=20026): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20026)] 12:24:37.807251 run osmo-stp_10.42.42.5(pid=20026): stdout: | (launched: 2022-12-13_12:24:36.351663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:37.945760 run osmo-stp_10.42.42.5(pid=20026): stderr: | 20221213122436543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122436543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122436544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122436544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122436545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122436545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122436545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:38.085476 run osmo-stp_10.42.42.5(pid=20026): stdout: | (launched: 2022-12-13_12:24:36.351663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:38.217503 run osmo-stp_10.42.42.5(pid=20026): stderr: | 20221213122436543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122436543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122436544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122436544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122436545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122436545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122436545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:38.374610 run patchelf(pid=20029): Terminating (SIGINT) 12:24:38.555094 run patchelf(pid=20029): Terminated: ok {rc=0} 12:24:38.685242 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20026): Process ended prematurely: osmo-stp_10.42.42.5(pid=20026) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20026)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 12:24:38.695009 tst ping.py:22: Test FAILED (6.7 sec) 12:24:38.723283 run osmo-hlr_10.42.42.2(pid=20023): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20023)] 12:24:38.773821 run osmo-hlr_10.42.42.2(pid=20023): stdout: | (launched: 2022-12-13_12:24:35.343121) 12:24:38.825614 run osmo-hlr_10.42.42.2(pid=20023): stderr: | 20221213122435540 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122435540 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122435540 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122435540 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122435540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122435540 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122435552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122435561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122435561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122435561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:38.878349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20022): Terminating (SIGTERM) 12:24:38.919924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20025): Terminating (SIGTERM) 12:24:38.962546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20028): Terminating (SIGTERM) 12:24:39.005252 --- ParallelTerminationStrategy: PID 20022 died... 12:24:39.025682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20022): Terminated: ok {rc=0} 12:24:39.072353 --- ParallelTerminationStrategy: PID 20025 died... 12:24:39.092379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20025): Terminated: ok {rc=0} 12:24:39.138839 --- ParallelTerminationStrategy: PID 20028 died... 12:24:39.158821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20028): Terminated: ok {rc=0} 12:24:39.247430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:24:40.335115 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:40.347073 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:40.423413 tst ping_idle_ping.py: using LAC 33924 12:24:40.543014 tst ping_idle_ping.py: using RAC 9 12:24:40.664580 tst ping_idle_ping.py: using CellId 33924 12:24:40.784571 tst ping_idle_ping.py: using BVCI 33925 12:24:40.894961 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:40.906097 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:40.916943 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:40.927767 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:40.939165 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:40.950566 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:40.962029 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:40.973284 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:41.089623 tst ping_idle_ping.py:24: start network... 12:24:41.293850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:41.766898 run create_hlr_db(pid=20030): Launched 12:24:41.893552 bus /gobi_6: Setting Powered False 12:24:42.954758 run create_hlr_db(pid=20030): Terminated: ok {rc=0} 12:24:43.398016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20032): Launched 12:24:43.722178 run osmo-hlr_10.42.42.2(pid=20033): Launched 12:24:43.845187 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:44.405306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20035): Launched 12:24:44.729619 run osmo-stp_10.42.42.5(pid=20036): Launched 12:24:44.853111 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:45.412621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20038): Launched 12:24:45.537807 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:45.811633 run patchelf(pid=20039): Launched 12:24:46.024845 run osmo-stp_10.42.42.5(pid=20036): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20036)] 12:24:46.159269 run osmo-stp_10.42.42.5(pid=20036): stdout: | (launched: 2022-12-13_12:24:44.670123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:46.293965 run osmo-stp_10.42.42.5(pid=20036): stderr: | 20221213122444860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122444860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122444860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122444861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122444861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122444861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122444861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:46.430764 run osmo-stp_10.42.42.5(pid=20036): stdout: | (launched: 2022-12-13_12:24:44.670123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:46.561705 run osmo-stp_10.42.42.5(pid=20036): stderr: | 20221213122444860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122444860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122444860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122444861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122444861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122444861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122444861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:46.717190 run patchelf(pid=20039): Terminating (SIGINT) 12:24:46.893682 run patchelf(pid=20039): Terminated: ok {rc=0} 12:24:47.022192 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20036): Process ended prematurely: osmo-stp_10.42.42.5(pid=20036) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20036)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:24:47.032470 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:24:47.061250 run osmo-hlr_10.42.42.2(pid=20033): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20033)] 12:24:47.113937 run osmo-hlr_10.42.42.2(pid=20033): stdout: | (launched: 2022-12-13_12:24:43.662788) 12:24:47.166790 run osmo-hlr_10.42.42.2(pid=20033): stderr: | 20221213122443859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122443859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122443859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122443859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122443859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122443859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122443872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122443880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122443880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122443880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:47.217176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20032): Terminating (SIGTERM) 12:24:47.258114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20035): Terminating (SIGTERM) 12:24:47.299941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20038): Terminating (SIGTERM) 12:24:47.341233 --- ParallelTerminationStrategy: PID 20032 died... 12:24:47.361008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20032): Terminated: ok {rc=0} 12:24:47.406119 --- ParallelTerminationStrategy: PID 20035 died... 12:24:47.425355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20035): Terminated: ok {rc=0} 12:24:47.470295 --- ParallelTerminationStrategy: PID 20038 died... 12:24:47.489687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20038): Terminated: ok {rc=0} 12:24:47.577748 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:24:48.894388 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:24:48.900865 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:24:48.935436 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:24:48.976519 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:24:49.067205 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:24:49.101234 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:24:49.140910 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:24:49.737930 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:24:49.791794 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:24:49.803246 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:24:49.876223 tst cs_paging_gprs_active.py: using LAC 33925 12:24:50.005373 tst cs_paging_gprs_active.py: using RAC 10 12:24:50.136115 tst cs_paging_gprs_active.py: using CellId 33925 12:24:50.265061 tst cs_paging_gprs_active.py: using BVCI 33926 12:24:50.387233 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:24:50.398765 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:24:50.410079 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:24:50.421381 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:24:50.432858 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:24:50.444523 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:24:50.456197 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:24:50.467642 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:24:50.479416 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:24:50.599017 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:24:50.726870 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:24:50.950187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:51.281810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20044): Launched 12:24:51.570365 run iperf3-srv_10.42.42.10(pid=20045): Launched 12:24:51.696713 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:24:51.918817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:52.250125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20046): Launched 12:24:52.536569 run iperf3-srv_10.42.42.10(pid=20047): Launched 12:24:52.662315 tst cs_paging_gprs_active.py:38: start network... 12:24:52.883585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:53.393225 run create_hlr_db(pid=20048): Launched 12:24:53.520083 bus /gobi_6: Setting Powered False 12:24:54.585742 run create_hlr_db(pid=20048): Terminated: ok {rc=0} 12:24:55.043697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20050): Launched 12:24:55.374602 run osmo-hlr_10.42.42.2(pid=20051): Launched 12:24:55.502125 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:56.073501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20053): Launched 12:24:56.404161 run osmo-stp_10.42.42.5(pid=20054): Launched 12:24:56.530945 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:57.100778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20056): Launched 12:24:57.228353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:57.507222 run patchelf(pid=20057): Launched 12:24:57.693320 run osmo-stp_10.42.42.5(pid=20054): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20054)] 12:24:57.832869 run osmo-stp_10.42.42.5(pid=20054): stdout: | (launched: 2022-12-13_12:24:56.343613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:57.974896 run osmo-stp_10.42.42.5(pid=20054): stderr: | 20221213122456533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122456533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122456533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122456534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122456534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122456534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122456534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:58.117470 run osmo-stp_10.42.42.5(pid=20054): stdout: | (launched: 2022-12-13_12:24:56.343613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:58.252577 run osmo-stp_10.42.42.5(pid=20054): stderr: | 20221213122456533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122456533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122456533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122456534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122456534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122456534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122456534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:58.413024 run patchelf(pid=20057): Terminating (SIGINT) 12:24:58.598504 run patchelf(pid=20057): Terminated: ok {rc=0} 12:24:58.731576 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20054): Process ended prematurely: osmo-stp_10.42.42.5(pid=20054) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20054)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:24:58.742019 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 12:24:58.771153 run osmo-hlr_10.42.42.2(pid=20051): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20051)] 12:24:58.822516 run osmo-hlr_10.42.42.2(pid=20051): stdout: | (launched: 2022-12-13_12:24:55.314217) 12:24:58.875587 run osmo-hlr_10.42.42.2(pid=20051): stderr: | 20221213122455511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122455511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122455511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122455511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122455511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122455512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122455524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122455532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122455532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122455532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:58.928893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20044): Terminating (SIGTERM) 12:24:58.971130 run iperf3-srv_10.42.42.10(pid=20045): Terminating (SIGTERM) 12:24:59.013787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20046): Terminating (SIGTERM) 12:24:59.056263 run iperf3-srv_10.42.42.10(pid=20047): Terminating (SIGTERM) 12:24:59.098608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20050): Terminating (SIGTERM) 12:24:59.140928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20053): Terminating (SIGTERM) 12:24:59.183309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20056): Terminating (SIGTERM) 12:24:59.225980 --- ParallelTerminationStrategy: PID 20044 died... 12:24:59.246677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20044): Terminated: ok {rc=0} 12:24:59.293875 --- ParallelTerminationStrategy: PID 20045 died... 12:24:59.314026 run iperf3-srv_10.42.42.10(pid=20045): Terminated {rc=256} 12:24:59.361220 --- ParallelTerminationStrategy: PID 20046 died... 12:24:59.381433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20046): Terminated: ok {rc=0} 12:24:59.428382 --- ParallelTerminationStrategy: PID 20047 died... 12:24:59.448604 run iperf3-srv_10.42.42.10(pid=20047): Terminated {rc=256} 12:24:59.495565 --- ParallelTerminationStrategy: PID 20050 died... 12:24:59.515753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20050): Terminated: ok {rc=0} 12:24:59.562957 --- ParallelTerminationStrategy: PID 20053 died... 12:24:59.583080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20053): Terminated: ok {rc=0} 12:24:59.629936 --- ParallelTerminationStrategy: PID 20056 died... 12:24:59.650073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20056): Terminated: ok {rc=0} 12:24:59.739523 bus /gobi_0: Setting Powered False 12:25:00.852629 bus /gobi_0: Setting Powered False 12:25:01.994292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:25:03.154162 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:03.165834 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:25:03.236572 tst iperf3.py: using LAC 33926 12:25:03.358465 tst iperf3.py: using RAC 11 12:25:03.481174 tst iperf3.py: using CellId 33926 12:25:03.604722 tst iperf3.py: using BVCI 33927 12:25:03.718589 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:03.729634 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:03.740382 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:03.751107 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:03.761904 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:03.772601 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:03.783436 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:03.794163 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:03.804886 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:03.920670 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:25:04.128268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:04.438209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20061): Launched 12:25:04.710158 run iperf3-srv_10.42.42.10(pid=20062): Launched 12:25:04.828483 tst iperf3.py:8: start network... 12:25:05.036253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:05.514820 run create_hlr_db(pid=20063): Launched 12:25:05.642147 bus /gobi_6: Setting Powered False 12:25:06.703937 run create_hlr_db(pid=20063): Terminated: ok {rc=0} 12:25:07.133729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20065): Launched 12:25:07.442316 run osmo-hlr_10.42.42.2(pid=20066): Launched 12:25:07.561147 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:08.096013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20068): Launched 12:25:08.404680 run osmo-stp_10.42.42.5(pid=20069): Launched 12:25:08.522588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:09.054938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20071): Launched 12:25:09.175172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:09.435753 run patchelf(pid=20072): Launched 12:25:09.607175 run osmo-stp_10.42.42.5(pid=20069): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20069)] 12:25:09.737391 run osmo-stp_10.42.42.5(pid=20069): stdout: | (launched: 2022-12-13_12:25:08.348014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:09.869174 run osmo-stp_10.42.42.5(pid=20069): stderr: | 20221213122508517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122508517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122508517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122508518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122508518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122508518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122508518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:10.000828 run osmo-stp_10.42.42.5(pid=20069): stdout: | (launched: 2022-12-13_12:25:08.348014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:10.126803 run osmo-stp_10.42.42.5(pid=20069): stderr: | 20221213122508517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122508517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122508517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122508518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122508518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122508518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122508518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:10.275990 run patchelf(pid=20072): Terminating (SIGINT) 12:25:10.448521 run patchelf(pid=20072): Terminated: ok {rc=0} 12:25:10.573465 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20069): Process ended prematurely: osmo-stp_10.42.42.5(pid=20069) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20069)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 12:25:10.583021 tst iperf3.py:8: Test FAILED (7.5 sec) 12:25:10.610758 run osmo-hlr_10.42.42.2(pid=20066): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20066)] 12:25:10.658790 run osmo-hlr_10.42.42.2(pid=20066): stdout: | (launched: 2022-12-13_12:25:07.385477) 12:25:10.708633 run osmo-hlr_10.42.42.2(pid=20066): stderr: | 20221213122507562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122507562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122507562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122507562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122507562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122507562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122507574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122507585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122507586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122507586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:10.759028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20061): Terminating (SIGTERM) 12:25:10.799638 run iperf3-srv_10.42.42.10(pid=20062): Terminating (SIGTERM) 12:25:10.839647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20065): Terminating (SIGTERM) 12:25:10.879889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20068): Terminating (SIGTERM) 12:25:10.919780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20071): Terminating (SIGTERM) 12:25:10.960440 --- ParallelTerminationStrategy: PID 20061 died... 12:25:10.979880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20061): Terminated: ok {rc=0} 12:25:11.024625 --- ParallelTerminationStrategy: PID 20062 died... 12:25:11.043555 run iperf3-srv_10.42.42.10(pid=20062): Terminated {rc=256} 12:25:11.088055 --- ParallelTerminationStrategy: PID 20065 died... 12:25:11.107147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20065): Terminated: ok {rc=0} 12:25:11.151866 --- ParallelTerminationStrategy: PID 20068 died... 12:25:11.170797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20068): Terminated: ok {rc=0} 12:25:11.215124 --- ParallelTerminationStrategy: PID 20071 died... 12:25:11.234236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20071): Terminated: ok {rc=0} 12:25:11.318461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:25:12.469837 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:12.482129 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:25:12.556276 tst iperf3m4.py: using LAC 33927 12:25:12.687587 tst iperf3m4.py: using RAC 12 12:25:12.818637 tst iperf3m4.py: using CellId 33927 12:25:12.947935 tst iperf3m4.py: using BVCI 33928 12:25:13.068690 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:13.080256 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:13.091506 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:13.102793 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:13.114312 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:13.125876 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:13.137675 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:13.149106 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:13.160697 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:13.282698 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:13.401630 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:13.521487 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:13.639485 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:25:13.847623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:14.158582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20073): Launched 12:25:14.431702 run iperf3-srv_10.42.42.10(pid=20074): Launched 12:25:14.547300 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:25:14.755175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:15.066400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20075): Launched 12:25:15.338038 run iperf3-srv_10.42.42.10(pid=20076): Launched 12:25:15.456170 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:25:15.664322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:16.009175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20077): Launched 12:25:16.382618 run iperf3-srv_10.42.42.10(pid=20078): Launched 12:25:16.514193 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:25:16.725896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:17.043311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20079): Launched 12:25:17.328379 run iperf3-srv_10.42.42.10(pid=20080): Launched 12:25:17.443849 tst iperf3m4.py:8: start network... 12:25:17.651035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:18.129281 run create_hlr_db(pid=20081): Launched 12:25:18.254642 bus /gobi_6: Setting Powered False 12:25:19.316396 run create_hlr_db(pid=20081): Terminated: ok {rc=0} 12:25:19.746052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20083): Launched 12:25:20.054124 run osmo-hlr_10.42.42.2(pid=20084): Launched 12:25:20.170244 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:20.701735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20086): Launched 12:25:21.011064 run osmo-stp_10.42.42.5(pid=20087): Launched 12:25:21.127431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:21.657949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20089): Launched 12:25:21.776642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:22.035990 run patchelf(pid=20090): Launched 12:25:22.209232 run osmo-stp_10.42.42.5(pid=20087): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20087)] 12:25:22.339473 run osmo-stp_10.42.42.5(pid=20087): stdout: | (launched: 2022-12-13_12:25:20.954038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:22.471225 run osmo-stp_10.42.42.5(pid=20087): stderr: | 20221213122521124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122521124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122521124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122521125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122521125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122521125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122521125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:22.602901 run osmo-stp_10.42.42.5(pid=20087): stdout: | (launched: 2022-12-13_12:25:20.954038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:22.728709 run osmo-stp_10.42.42.5(pid=20087): stderr: | 20221213122521124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122521124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122521124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122521125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122521125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122521125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122521125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:22.878319 run patchelf(pid=20090): Terminating (SIGINT) 12:25:23.050345 run patchelf(pid=20090): Terminated: ok {rc=0} 12:25:23.174691 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20087): Process ended prematurely: osmo-stp_10.42.42.5(pid=20087) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20087)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:25:23.184320 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:25:23.212222 run osmo-hlr_10.42.42.2(pid=20084): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20084)] 12:25:23.260280 run osmo-hlr_10.42.42.2(pid=20084): stdout: | (launched: 2022-12-13_12:25:19.996921) 12:25:23.310188 run osmo-hlr_10.42.42.2(pid=20084): stderr: | 20221213122520172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122520172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122520172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122520172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122520172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122520172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122520190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122520201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122520201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122520202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:23.360571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20073): Terminating (SIGTERM) 12:25:23.400741 run iperf3-srv_10.42.42.10(pid=20074): Terminating (SIGTERM) 12:25:23.440878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20075): Terminating (SIGTERM) 12:25:23.481349 run iperf3-srv_10.42.42.10(pid=20076): Terminating (SIGTERM) 12:25:23.521470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20077): Terminating (SIGTERM) 12:25:23.561646 run iperf3-srv_10.42.42.10(pid=20078): Terminating (SIGTERM) 12:25:23.601728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20079): Terminating (SIGTERM) 12:25:23.641923 run iperf3-srv_10.42.42.10(pid=20080): Terminating (SIGTERM) 12:25:23.681808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20083): Terminating (SIGTERM) 12:25:23.721930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20086): Terminating (SIGTERM) 12:25:23.761996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20089): Terminating (SIGTERM) 12:25:23.802454 --- ParallelTerminationStrategy: PID 20073 died... 12:25:23.821946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20073): Terminated: ok {rc=0} 12:25:23.866609 --- ParallelTerminationStrategy: PID 20074 died... 12:25:23.885585 run iperf3-srv_10.42.42.10(pid=20074): Terminated {rc=256} 12:25:23.929807 --- ParallelTerminationStrategy: PID 20075 died... 12:25:23.948799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20075): Terminated: ok {rc=0} 12:25:23.993259 --- ParallelTerminationStrategy: PID 20076 died... 12:25:24.012218 run iperf3-srv_10.42.42.10(pid=20076): Terminated {rc=256} 12:25:24.056634 --- ParallelTerminationStrategy: PID 20077 died... 12:25:24.075631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20077): Terminated: ok {rc=0} 12:25:24.120158 --- ParallelTerminationStrategy: PID 20078 died... 12:25:24.139131 run iperf3-srv_10.42.42.10(pid=20078): Terminated {rc=256} 12:25:24.183645 --- ParallelTerminationStrategy: PID 20079 died... 12:25:24.202739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20079): Terminated: ok {rc=0} 12:25:24.247316 --- ParallelTerminationStrategy: PID 20080 died... 12:25:24.266384 run iperf3-srv_10.42.42.10(pid=20080): Terminated {rc=256} 12:25:24.310636 --- ParallelTerminationStrategy: PID 20083 died... 12:25:24.329737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20083): Terminated: ok {rc=0} 12:25:24.374689 --- ParallelTerminationStrategy: PID 20086 died... 12:25:24.393637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20086): Terminated: ok {rc=0} 12:25:24.437996 --- ParallelTerminationStrategy: PID 20089 died... 12:25:24.457024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20089): Terminated: ok {rc=0} 12:25:24.541385 bus /gobi_4: Setting Powered False 12:25:25.640847 bus /gobi_4: Setting Powered False 12:25:26.758528 bus /gobi_1: Setting Powered False 12:25:27.858874 bus /gobi_1: Setting Powered False 12:25:28.976580 bus /gobi_0: Setting Powered False 12:25:30.075024 bus /gobi_0: Setting Powered False 12:25:31.197226 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:25:32.313667 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:32.325762 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:25:32.401184 tst ping.py: using LAC 33928 12:25:32.528810 tst ping.py: using RAC 13 12:25:32.656083 tst ping.py: using CellId 33928 12:25:32.776483 tst ping.py: using BVCI 33929 12:25:32.885761 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:32.896846 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:32.907774 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:32.919027 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:32.929811 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:32.941088 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:32.952099 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:32.963029 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:33.080731 tst ping.py:19: start network... 12:25:33.301134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:33.802926 run create_hlr_db(pid=20091): Launched 12:25:33.927759 bus /gobi_6: Setting Powered False 12:25:34.993214 run create_hlr_db(pid=20091): Terminated: ok {rc=0} 12:25:35.427745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20093): Launched 12:25:35.732316 run osmo-hlr_10.42.42.2(pid=20094): Launched 12:25:35.848215 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:36.371409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20096): Launched 12:25:36.674806 run osmo-stp_10.42.42.5(pid=20097): Launched 12:25:36.790191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:37.314037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20099): Launched 12:25:37.429596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:37.685635 run patchelf(pid=20100): Launched 12:25:37.854950 run osmo-stp_10.42.42.5(pid=20097): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20097)] 12:25:37.983361 run osmo-stp_10.42.42.5(pid=20097): stdout: | (launched: 2022-12-13_12:25:36.618813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:38.113786 run osmo-stp_10.42.42.5(pid=20097): stderr: | 20221213122536789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122536789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122536790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122536790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122536791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122536791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122536791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:38.243870 run osmo-stp_10.42.42.5(pid=20097): stdout: | (launched: 2022-12-13_12:25:36.618813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:38.368150 run osmo-stp_10.42.42.5(pid=20097): stderr: | 20221213122536789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122536789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122536790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122536790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122536791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122536791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122536791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:38.515395 run patchelf(pid=20100): Terminating (SIGINT) 12:25:38.685347 run patchelf(pid=20100): Terminated: ok {rc=0} 12:25:38.807985 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20097): Process ended prematurely: osmo-stp_10.42.42.5(pid=20097) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20097)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 12:25:38.817030 tst ping.py:22: Test FAILED (6.5 sec) 12:25:38.844267 run osmo-hlr_10.42.42.2(pid=20094): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20094)] 12:25:38.892081 run osmo-hlr_10.42.42.2(pid=20094): stdout: | (launched: 2022-12-13_12:25:35.676251) 12:25:38.941688 run osmo-hlr_10.42.42.2(pid=20094): stderr: | 20221213122535850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122535850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122535850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122535850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122535850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122535850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122535863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122535871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122535872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122535872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:38.992263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20093): Terminating (SIGTERM) 12:25:39.032565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20096): Terminating (SIGTERM) 12:25:39.072463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20099): Terminating (SIGTERM) 12:25:39.112864 --- ParallelTerminationStrategy: PID 20093 died... 12:25:39.132298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20093): Terminated: ok {rc=0} 12:25:39.176500 --- ParallelTerminationStrategy: PID 20096 died... 12:25:39.195360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20096): Terminated: ok {rc=0} 12:25:39.239350 --- ParallelTerminationStrategy: PID 20099 died... 12:25:39.258234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20099): Terminated: ok {rc=0} 12:25:39.341844 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:25:40.430368 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:40.443306 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:25:40.518639 tst ping_idle_ping.py: using LAC 33929 12:25:40.647144 tst ping_idle_ping.py: using RAC 14 12:25:40.773814 tst ping_idle_ping.py: using CellId 33929 12:25:40.901307 tst ping_idle_ping.py: using BVCI 33930 12:25:41.018641 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:41.030800 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:41.042356 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:41.053793 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:41.065400 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:41.077242 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:41.089020 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:41.100714 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:41.220886 tst ping_idle_ping.py:24: start network... 12:25:41.439651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:41.944933 run create_hlr_db(pid=20101): Launched 12:25:42.069547 bus /gobi_6: Setting Powered False 12:25:43.134341 run create_hlr_db(pid=20101): Terminated: ok {rc=0} 12:25:43.588201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20103): Launched 12:25:43.915907 run osmo-hlr_10.42.42.2(pid=20104): Launched 12:25:44.041142 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:44.603026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20106): Launched 12:25:44.928293 run osmo-stp_10.42.42.5(pid=20107): Launched 12:25:45.054612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:45.614730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20109): Launched 12:25:45.740136 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:46.029370 run patchelf(pid=20110): Launched 12:25:46.220272 run osmo-stp_10.42.42.5(pid=20107): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20107)] 12:25:46.353187 run osmo-stp_10.42.42.5(pid=20107): stdout: | (launched: 2022-12-13_12:25:44.868514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:46.486310 run osmo-stp_10.42.42.5(pid=20107): stderr: | 20221213122545058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122545058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122545059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122545059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122545059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122545060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122545060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:46.621423 run osmo-stp_10.42.42.5(pid=20107): stdout: | (launched: 2022-12-13_12:25:44.868514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:46.750925 run osmo-stp_10.42.42.5(pid=20107): stderr: | 20221213122545058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122545058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122545059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122545059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122545059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122545060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122545060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:46.902958 run patchelf(pid=20110): Terminating (SIGINT) 12:25:47.078367 run patchelf(pid=20110): Terminated: ok {rc=0} 12:25:47.205142 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20107): Process ended prematurely: osmo-stp_10.42.42.5(pid=20107) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20107)] [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:25:47.214309 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:25:47.241418 run osmo-hlr_10.42.42.2(pid=20104): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20104)] 12:25:47.289693 run osmo-hlr_10.42.42.2(pid=20104): stdout: | (launched: 2022-12-13_12:25:43.856108) 12:25:47.349199 run osmo-hlr_10.42.42.2(pid=20104): stderr: | 20221213122544054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122544054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122544054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122544054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122544054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122544054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122544069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122544078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122544078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122544078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:47.399191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20103): Terminating (SIGTERM) 12:25:47.439081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20106): Terminating (SIGTERM) 12:25:47.479028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20109): Terminating (SIGTERM) 12:25:47.519239 --- ParallelTerminationStrategy: PID 20103 died... 12:25:47.538606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20103): Terminated: ok {rc=0} 12:25:47.582864 --- ParallelTerminationStrategy: PID 20106 died... 12:25:47.601751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20106): Terminated: ok {rc=0} 12:25:47.645878 --- ParallelTerminationStrategy: PID 20109 died... 12:25:47.664816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20109): Terminated: ok {rc=0} 12:25:47.751501 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:25:49.064628 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:25:49.073405 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:25:49.107602 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:25:49.142582 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:25:49.195178 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:25:49.229841 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:25:49.265582 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:25:49.821905 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:25:49.827995 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:25:49.839826 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:25:49.913099 tst switch_tch_pdch.py: using LAC 33930 12:25:50.029638 tst switch_tch_pdch.py: using RAC 15 12:25:50.148116 tst switch_tch_pdch.py: using CellId 33930 12:25:50.264041 tst switch_tch_pdch.py: using BVCI 33931 12:25:50.372325 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:25:50.383606 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:25:50.394639 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:25:50.405733 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:25:50.417247 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:25:50.428673 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:25:50.440396 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:25:50.452005 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:25:50.571028 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:25:50.694705 tst switch_tch_pdch.py:51: start network... 12:25:50.895657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:51.358905 run create_hlr_db(pid=20116): Launched 12:25:51.479414 bus /gobi_6: Setting Powered False 12:25:52.539346 run create_hlr_db(pid=20116): Terminated: ok {rc=0} 12:25:52.975497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20118): Launched 12:25:53.278784 run osmo-hlr_10.42.42.2(pid=20119): Launched 12:25:53.391379 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:53.913551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20121): Launched 12:25:54.213332 run osmo-stp_10.42.42.5(pid=20122): Launched 12:25:54.326572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:54.839002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20124): Launched 12:25:54.952444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:55.204023 run patchelf(pid=20125): Launched 12:25:55.369740 run osmo-stp_10.42.42.5(pid=20122): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20122)] 12:25:55.495188 run osmo-stp_10.42.42.5(pid=20122): stdout: | (launched: 2022-12-13_12:25:54.157962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:55.622514 run osmo-stp_10.42.42.5(pid=20122): stderr: | 20221213122554324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122554324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122554324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122554325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122554325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122554325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122554326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:55.749356 run osmo-stp_10.42.42.5(pid=20122): stdout: | (launched: 2022-12-13_12:25:54.157962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:55.870621 run osmo-stp_10.42.42.5(pid=20122): stderr: | 20221213122554324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122554324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122554324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122554325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122554325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122554325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122554326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:56.014469 run patchelf(pid=20125): Terminating (SIGINT) 12:25:56.181106 run patchelf(pid=20125): Terminated: ok {rc=0} 12:25:56.300810 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20122): Process ended prematurely: osmo-stp_10.42.42.5(pid=20122) [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20122)] [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:25:56.309750 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 12:25:56.336255 run osmo-hlr_10.42.42.2(pid=20119): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20119)] 12:25:56.383034 run osmo-hlr_10.42.42.2(pid=20119): stdout: | (launched: 2022-12-13_12:25:53.223586) 12:25:56.431467 run osmo-hlr_10.42.42.2(pid=20119): stderr: | 20221213122553396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122553397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122553397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122553397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122553397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122553397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122553410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122553420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122553420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122553420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:56.480603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20118): Terminating (SIGTERM) 12:25:56.519827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20121): Terminating (SIGTERM) 12:25:56.559158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20124): Terminating (SIGTERM) 12:25:56.598675 --- ParallelTerminationStrategy: PID 20118 died... 12:25:56.616893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20118): Terminated: ok {rc=0} 12:25:56.660919 --- ParallelTerminationStrategy: PID 20121 died... 12:25:56.679860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20121): Terminated: ok {rc=0} 12:25:56.723637 --- ParallelTerminationStrategy: PID 20124 died... 12:25:56.742388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20124): Terminated: ok {rc=0} 12:25:56.828701 bus /gobi_0: Setting Powered False 12:25:57.928041 bus /gobi_0: Setting Powered False 12:25:59.045245 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:26:00.298441 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:00.305792 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:26:00.341477 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:26:00.377319 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:26:00.432430 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:26:00.465682 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:26:00.499816 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:26:01.073447 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:26:01.079324 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:01.092544 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:26:01.162885 tst switch_tch_pdch.py: using LAC 33931 12:26:01.290440 tst switch_tch_pdch.py: using RAC 16 12:26:01.410583 tst switch_tch_pdch.py: using CellId 33931 12:26:01.536556 tst switch_tch_pdch.py: using BVCI 33932 12:26:01.649219 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:01.660561 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:01.672437 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:01.684306 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:01.696022 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:01.707938 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:01.719771 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:01.731568 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:26:01.870026 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:26:02.017896 tst switch_tch_pdch.py:51: start network... 12:26:02.298524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:02.738953 run create_hlr_db(pid=20129): Launched 12:26:02.861570 bus /gobi_6: Setting Powered False 12:26:03.921404 run create_hlr_db(pid=20129): Terminated: ok {rc=0} 12:26:04.310470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20131): Launched 12:26:04.607727 run osmo-hlr_10.42.42.2(pid=20132): Launched 12:26:04.719706 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:05.203960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20134): Launched 12:26:05.501692 run osmo-stp_10.42.42.5(pid=20135): Launched 12:26:05.614742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:06.100875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20137): Launched 12:26:06.214653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:06.465781 run patchelf(pid=20138): Launched 12:26:06.632242 run osmo-stp_10.42.42.5(pid=20135): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20135)] 12:26:06.758376 run osmo-stp_10.42.42.5(pid=20135): stdout: | (launched: 2022-12-13_12:26:05.446589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:06.886124 run osmo-stp_10.42.42.5(pid=20135): stderr: | 20221213122605614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122605614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122605614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122605614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122605615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122605615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122605615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:07.014121 run osmo-stp_10.42.42.5(pid=20135): stdout: | (launched: 2022-12-13_12:26:05.446589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:07.136058 run osmo-stp_10.42.42.5(pid=20135): stderr: | 20221213122605614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122605614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122605614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122605614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122605615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122605615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122605615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:07.281683 run patchelf(pid=20138): Terminating (SIGINT) 12:26:07.449186 run patchelf(pid=20138): Terminated: ok {rc=0} 12:26:07.569829 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20135): Process ended prematurely: osmo-stp_10.42.42.5(pid=20135) [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20135)] [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:26:07.578672 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 12:26:07.605235 run osmo-hlr_10.42.42.2(pid=20132): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20132)] 12:26:07.652115 run osmo-hlr_10.42.42.2(pid=20132): stdout: | (launched: 2022-12-13_12:26:04.552486) 12:26:07.700787 run osmo-hlr_10.42.42.2(pid=20132): stderr: | 20221213122604725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122604725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122604725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122604725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122604725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122604725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122604740 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122604750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122604750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122604751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:07.749941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20131): Terminating (SIGTERM) 12:26:07.789512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20134): Terminating (SIGTERM) 12:26:07.829082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20137): Terminating (SIGTERM) 12:26:07.868682 --- ParallelTerminationStrategy: PID 20131 died... 12:26:07.887641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20131): Terminated: ok {rc=0} 12:26:07.931252 --- ParallelTerminationStrategy: PID 20134 died... 12:26:07.949821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20134): Terminated: ok {rc=0} 12:26:07.993341 --- ParallelTerminationStrategy: PID 20137 died... 12:26:08.011931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20137): Terminated: ok {rc=0} 12:26:08.097175 bus /gobi_0: Setting Powered False 12:26:09.196521 bus /gobi_0: Setting Powered False 12:26:10.311784 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 12:26:11.561380 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:11.565172 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:26:11.594011 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 12:26:11.600696 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:26:11.651846 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:26:11.680750 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 12:26:11.687426 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:26:12.225897 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 12:26:12.230683 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 12:26:12.241603 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:26:12.285269 tst mo_mt_sms.py: using LAC 33932 12:26:12.403714 tst mo_mt_sms.py: using RAC 17 12:26:12.521365 tst mo_mt_sms.py: using CellId 33932 12:26:12.636690 tst mo_mt_sms.py: using BVCI 33933 12:26:12.743756 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:26:12.861773 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:26:12.975396 tst mo_mt_sms.py:9: start nitb and bts... 12:26:13.177263 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:26:13.784571 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20143): Launched 12:26:14.082341 run osmo-nitb_10.42.42.2(pid=20144): Launched 12:26:14.247264 run osmo-nitb_10.42.42.2(pid=20144): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20144)] 12:26:14.380640 run osmo-nitb_10.42.42.2(pid=20144): stdout: | (launched: 2022-12-13_12:26:14.027350) 12:26:14.515436 run osmo-nitb_10.42.42.2(pid=20144): stderr: | (launched: 2022-12-13_12:26:14.071581) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:26:14.650671 run osmo-nitb_10.42.42.2(pid=20144): stdout: | (launched: 2022-12-13_12:26:14.027350) 12:26:14.779339 run osmo-nitb_10.42.42.2(pid=20144): stderr: | (launched: 2022-12-13_12:26:14.071581) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20144) [trial-2389↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20144)] 12:26:15.194576 tst osmo-nitb_10.42.42.2(pid=20144): stdout: | (launched: 2022-12-13_12:26:14.027350) 12:26:15.315950 tst osmo-nitb_10.42.42.2(pid=20144): stderr: | (launched: 2022-12-13_12:26:14.071581) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:26:15.457828 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20144) [trial-2389↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20144)] [trial-2389↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 12:26:15.466119 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 12:26:15.472657 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20143): Terminating (SIGTERM) 12:26:15.680844 --- ParallelTerminationStrategy: PID 20143 died... 12:26:15.701291 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20143): Terminated: ok {rc=0} 12:26:15.785014 bus /sierra_3: Setting Powered False 12:26:16.890932 bus /sierra_3: Setting Powered False 12:26:18.007859 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 12:26:19.206799 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:19.210987 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:26:19.240724 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:26:19.269495 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:26:19.323730 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:26:19.353086 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:26:19.379527 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:26:19.925669 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 12:26:19.930766 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:19.941587 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:26:19.984812 tst mo_mt_sms.py: using LAC 33933 12:26:20.100713 tst mo_mt_sms.py: using RAC 18 12:26:20.222664 tst mo_mt_sms.py: using CellId 33933 12:26:20.338246 tst mo_mt_sms.py: using BVCI 33934 12:26:20.445483 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:20.456124 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:20.466722 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:20.477169 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:20.487633 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:20.498102 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:26:20.611164 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:26:20.728124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:21.221502 run create_hlr_db(pid=20148): Launched 12:26:21.344359 bus /sierra_2: Setting Powered False 12:26:22.407787 run create_hlr_db(pid=20148): Terminated: ok {rc=0} 12:26:22.852081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20150): Launched 12:26:23.171092 run osmo-hlr_10.42.42.2(pid=20151): Launched 12:26:23.292452 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:23.838859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20153): Launched 12:26:24.158294 run osmo-stp_10.42.42.5(pid=20154): Launched 12:26:24.280748 run osmo-msc_10.42.42.6: Starting osmo-msc 12:26:24.861068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20156): Launched 12:26:25.181060 run osmo-msc_10.42.42.6(pid=20157): Launched 12:26:25.359554 run osmo-stp_10.42.42.5(pid=20154): ERR: Terminated: ERROR {rc=1} [trial-2389↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20154)] 12:26:25.494183 run osmo-stp_10.42.42.5(pid=20154): stdout: | (launched: 2022-12-13_12:26:24.099731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:25.629328 run osmo-stp_10.42.42.5(pid=20154): stderr: | 20221213122624285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122624285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122624285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122624286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122624286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122624286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122624286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:25.763331 run osmo-stp_10.42.42.5(pid=20154): stdout: | (launched: 2022-12-13_12:26:24.099731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:25.890415 run osmo-stp_10.42.42.5(pid=20154): stderr: | 20221213122624285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122624285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122624285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122624286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122624286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122624286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122624286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:26.042794 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20154): Process ended prematurely: osmo-stp_10.42.42.5(pid=20154) [trial-2389↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20154)] [trial-2389↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 12:26:26.051795 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 12:26:26.079796 run osmo-hlr_10.42.42.2(pid=20151): ERR: Terminated: ERROR {rc=237} [trial-2389↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20151)] 12:26:26.131673 run osmo-hlr_10.42.42.2(pid=20151): stdout: | (launched: 2022-12-13_12:26:23.112670) 12:26:26.184531 run osmo-hlr_10.42.42.2(pid=20151): stderr: | 20221213122623304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122623304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122623304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122623304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122623304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122623305 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122623317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122623325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122623325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122623325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:26.257989 run osmo-msc_10.42.42.6(pid=20157): ERR: Terminated: ERROR {rc=2} [trial-2389↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20157)] 12:26:26.308686 run osmo-msc_10.42.42.6(pid=20157): stdout: | (launched: 2022-12-13_12:26:25.122528) 12:26:26.361886 run osmo-msc_10.42.42.6(pid=20157): stderr: | 20221213122625440 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122625440 DLGLOBAL DEBUG validating counter group 0x7fb8c1c7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122625440 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122625440 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122625440 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122625441 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122625442 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122625443 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122625443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122625443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:26:26.415074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20150): Terminating (SIGTERM) 12:26:26.457305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20153): Terminating (SIGTERM) 12:26:26.500023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20156): Terminating (SIGTERM) 12:26:26.543095 --- ParallelTerminationStrategy: PID 20150 died... 12:26:26.563634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20150): Terminated: ok {rc=0} 12:26:26.611347 --- ParallelTerminationStrategy: PID 20153 died... 12:26:26.631452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20153): Terminated: ok {rc=0} 12:26:26.678555 --- ParallelTerminationStrategy: PID 20156 died... 12:26:26.698734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20156): Terminated: ok {rc=0} 12:26:26.789080 bus /sierra_3: Setting Powered False 12:26:27.888415 bus /sierra_3: Setting Powered False 12:26:29.004915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 12:26:30.235639 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:30.239630 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:26:30.268796 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 12:26:30.275725 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 12:26:30.310119 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:26:30.339557 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 12:26:30.346323 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 12:26:30.870758 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 12:26:30.876442 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 12:26:30.892563 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:26:30.939901 tst assert_extension.py: using LAC 33934 12:26:31.070230 tst assert_extension.py: using RAC 19 12:26:31.234896 tst assert_extension.py: using CellId 33934 12:26:31.364478 tst assert_extension.py: using BVCI 33935 12:26:31.486858 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 12:26:31.611091 tst assert_extension.py:10: start nitb and bts... 12:26:31.833489 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:26:32.477523 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20163): Launched 12:26:32.775644 run osmo-nitb_10.42.42.2(pid=20164): Launched 12:26:32.942489 run osmo-nitb_10.42.42.2(pid=20164): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20164)] 12:26:33.075800 run osmo-nitb_10.42.42.2(pid=20164): stdout: | (launched: 2022-12-13_12:26:32.720892) 12:26:33.211109 run osmo-nitb_10.42.42.2(pid=20164): stderr: | (launched: 2022-12-13_12:26:32.765378) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:26:33.346525 run osmo-nitb_10.42.42.2(pid=20164): stdout: | (launched: 2022-12-13_12:26:32.720892) 12:26:33.475937 run osmo-nitb_10.42.42.2(pid=20164): stderr: | (launched: 2022-12-13_12:26:32.765378) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20164): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20164) [trial-2389↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20164)] 12:26:33.889956 tst osmo-nitb_10.42.42.2(pid=20164): stdout: | (launched: 2022-12-13_12:26:32.720892) 12:26:34.010766 tst osmo-nitb_10.42.42.2(pid=20164): stderr: | (launched: 2022-12-13_12:26:32.765378) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:26:34.153093 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20164): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20164) [trial-2389↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20164)] [trial-2389↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 12:26:34.161525 tst assert_extension.py:12: Test FAILED (3.3 sec) 12:26:34.168367 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20163): Terminating (SIGTERM) 12:26:34.377296 --- ParallelTerminationStrategy: PID 20163 died... 12:26:34.397756 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20163): Terminated: ok {rc=0} 12:26:34.484076 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 12:26:35.659689 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:35.664158 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:26:35.694033 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:26:35.721135 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 12:26:35.756218 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:26:35.785474 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:26:35.812130 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 12:26:36.342592 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 12:26:36.349400 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:36.360712 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:26:36.406704 tst assert_extension.py: using LAC 33935 12:26:36.532923 tst assert_extension.py: using RAC 20 12:26:36.656625 tst assert_extension.py: using CellId 33935 12:26:36.780404 tst assert_extension.py: using BVCI 33936 12:26:36.895380 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:36.906712 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:36.917866 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:36.928855 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:36.940230 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:26:36.951532 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 12:26:37.066714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:37.529350 run create_hlr_db(pid=20169): Launched 12:26:37.651344 bus /sierra_2: Setting Powered False 12:26:38.711287 run create_hlr_db(pid=20169): Terminated: ok {rc=0} 12:26:39.148157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20171): Launched 12:26:39.467734 run osmo-hlr_10.42.42.2(pid=20172): Launched 12:26:39.589127 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:40.146631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20174): Launched 12:26:40.466068 run osmo-stp_10.42.42.5(pid=20175): Launched 12:26:40.587485 run osmo-msc_10.42.42.6: Starting osmo-msc 12:26:41.161494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20177): Launched 12:26:41.480128 run osmo-msc_10.42.42.6(pid=20178): Launched 12:26:41.657821 run osmo-stp_10.42.42.5(pid=20175): ERR: Terminated: ERROR {rc=1} [trial-2389↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20175)] 12:26:41.793841 run osmo-stp_10.42.42.5(pid=20175): stdout: | (launched: 2022-12-13_12:26:40.407702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:41.929091 run osmo-stp_10.42.42.5(pid=20175): stderr: | 20221213122640595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122640595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122640595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122640596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122640596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122640596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122640596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:42.062109 run osmo-stp_10.42.42.5(pid=20175): stdout: | (launched: 2022-12-13_12:26:40.407702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:42.188740 run osmo-stp_10.42.42.5(pid=20175): stderr: | 20221213122640595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122640595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122640595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122640596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122640596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122640596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122640596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:42.340494 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20175): Process ended prematurely: osmo-stp_10.42.42.5(pid=20175) [trial-2389↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20175)] [trial-2389↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 12:26:42.349324 tst assert_extension.py:17: Test FAILED (6.0 sec) 12:26:42.376577 run osmo-hlr_10.42.42.2(pid=20172): ERR: Terminated: ERROR {rc=237} [trial-2389↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20172)] 12:26:42.426692 run osmo-hlr_10.42.42.2(pid=20172): stdout: | (launched: 2022-12-13_12:26:39.409137) 12:26:42.478839 run osmo-hlr_10.42.42.2(pid=20172): stderr: | 20221213122639603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122639603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122639603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122639603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122639603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122639603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122639615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122639623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122639624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122639624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:42.551016 run osmo-msc_10.42.42.6(pid=20178): ERR: Terminated: ERROR {rc=2} [trial-2389↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20178)] 12:26:42.600442 run osmo-msc_10.42.42.6(pid=20178): stdout: | (launched: 2022-12-13_12:26:41.421826) 12:26:42.652320 run osmo-msc_10.42.42.6(pid=20178): stderr: | 20221213122641740 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122641740 DLGLOBAL DEBUG validating counter group 0x7f5ae4a43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122641740 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122641740 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122641740 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122641740 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122641742 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122641742 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122641743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122641743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:26:42.704783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20171): Terminating (SIGTERM) 12:26:42.746165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20174): Terminating (SIGTERM) 12:26:42.788270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20177): Terminating (SIGTERM) 12:26:42.830613 --- ParallelTerminationStrategy: PID 20171 died... 12:26:42.850927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20171): Terminated: ok {rc=0} 12:26:42.897215 --- ParallelTerminationStrategy: PID 20174 died... 12:26:42.916794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20174): Terminated: ok {rc=0} 12:26:42.963006 --- ParallelTerminationStrategy: PID 20177 died... 12:26:42.982910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20177): Terminated: ok {rc=0} 12:26:43.071038 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:26:44.280557 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:44.287498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:26:44.316906 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:26:44.344579 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:26:44.397593 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:26:44.427808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:26:44.456295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:26:45.005044 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:26:45.055049 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:45.066636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:26:45.131864 tst mo_mt_call.py: using LAC 33936 12:26:45.251804 tst mo_mt_call.py: using RAC 21 12:26:45.377238 tst mo_mt_call.py: using CellId 33936 12:26:45.505918 tst mo_mt_call.py: using BVCI 33937 12:26:45.618486 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:45.629834 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:45.640927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:45.652039 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:45.663185 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:45.674292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:26:45.787756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:26:45.924555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:46.452834 run create_hlr_db(pid=20183): Launched 12:26:46.642005 bus /sierra_2: Setting Powered False 12:26:47.706685 run create_hlr_db(pid=20183): Terminated: ok {rc=0} 12:26:48.161959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20185): Launched 12:26:48.488462 run osmo-hlr_10.42.42.2(pid=20186): Launched 12:26:48.612603 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:49.169370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20188): Launched 12:26:49.496063 run osmo-stp_10.42.42.5(pid=20189): Launched 12:26:49.620776 run osmo-msc_10.42.42.6: Starting osmo-msc 12:26:50.206214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20191): Launched 12:26:50.530744 run osmo-msc_10.42.42.6(pid=20192): Launched 12:26:50.712007 run osmo-stp_10.42.42.5(pid=20189): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20189)] 12:26:50.848431 run osmo-stp_10.42.42.5(pid=20189): stdout: | (launched: 2022-12-13_12:26:49.436267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:50.985722 run osmo-stp_10.42.42.5(pid=20189): stderr: | 20221213122649627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122649627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122649627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122649628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122649628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122649628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122649629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:51.122266 run osmo-stp_10.42.42.5(pid=20189): stdout: | (launched: 2022-12-13_12:26:49.436267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:51.251062 run osmo-stp_10.42.42.5(pid=20189): stderr: | 20221213122649627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122649627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122649627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122649628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122649628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122649628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122649629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:51.405370 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20189): Process ended prematurely: osmo-stp_10.42.42.5(pid=20189) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20189)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:26:51.414932 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:26:51.442656 run osmo-hlr_10.42.42.2(pid=20186): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20186)] 12:26:51.492934 run osmo-hlr_10.42.42.2(pid=20186): stdout: | (launched: 2022-12-13_12:26:48.428489) 12:26:51.545240 run osmo-hlr_10.42.42.2(pid=20186): stderr: | 20221213122648623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122648623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122648623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122648623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122648623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122648623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122648636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122648646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122648646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122648646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:51.617913 run osmo-msc_10.42.42.6(pid=20192): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20192)] 12:26:51.667466 run osmo-msc_10.42.42.6(pid=20192): stdout: | (launched: 2022-12-13_12:26:50.471531) 12:26:51.719367 run osmo-msc_10.42.42.6(pid=20192): stderr: | 20221213122650790 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122650790 DLGLOBAL DEBUG validating counter group 0x7f5958519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122650790 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122650790 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122650791 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122650791 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122650792 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122650793 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122650793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122650793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:26:51.771055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20185): Terminating (SIGTERM) 12:26:51.812558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20188): Terminating (SIGTERM) 12:26:51.854234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20191): Terminating (SIGTERM) 12:26:51.896405 --- ParallelTerminationStrategy: PID 20185 died... 12:26:51.916687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20185): Terminated: ok {rc=0} 12:26:51.962947 --- ParallelTerminationStrategy: PID 20188 died... 12:26:51.982862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20188): Terminated: ok {rc=0} 12:26:52.028873 --- ParallelTerminationStrategy: PID 20191 died... 12:26:52.048810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20191): Terminated: ok {rc=0} 12:26:52.136874 bus /sierra_3: Setting Powered False 12:26:53.236235 bus /sierra_3: Setting Powered False 12:26:54.353842 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:26:55.499260 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:55.511179 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:26:55.577686 tst mo_mt_call_osmux.py: using LAC 33937 12:26:55.706935 tst mo_mt_call_osmux.py: using RAC 22 12:26:55.833845 tst mo_mt_call_osmux.py: using CellId 33937 12:26:55.963592 tst mo_mt_call_osmux.py: using BVCI 33938 12:26:56.084107 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:56.096335 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:56.108192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:56.120078 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:56.132299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:26:56.144388 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:26:56.260529 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:26:56.380028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:56.882635 run create_hlr_db(pid=20194): Launched 12:26:57.006231 bus /sierra_2: Setting Powered False 12:26:58.071168 run create_hlr_db(pid=20194): Terminated: ok {rc=0} 12:26:58.505928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20196): Launched 12:26:58.809563 run osmo-hlr_10.42.42.2(pid=20197): Launched 12:26:58.925797 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:59.486480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20199): Launched 12:26:59.812233 run osmo-stp_10.42.42.5(pid=20200): Launched 12:26:59.935743 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:00.526597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20202): Launched 12:27:00.885868 run osmo-msc_10.42.42.6(pid=20203): Launched 12:27:01.120160 run osmo-stp_10.42.42.5(pid=20200): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20200)] 12:27:01.538898 run osmo-stp_10.42.42.5(pid=20200): stdout: | (launched: 2022-12-13_12:26:59.752534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:01.792456 run osmo-stp_10.42.42.5(pid=20200): stderr: | 20221213122659940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122659940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122659941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122659941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122659942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122659942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122659942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:01.923460 run osmo-stp_10.42.42.5(pid=20200): stdout: | (launched: 2022-12-13_12:26:59.752534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:02.059637 run osmo-stp_10.42.42.5(pid=20200): stderr: | 20221213122659940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122659940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122659941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122659941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122659942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122659942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122659942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:02.250701 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20200): Process ended prematurely: osmo-stp_10.42.42.5(pid=20200) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20200)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:27:02.259992 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 12:27:02.287980 run osmo-hlr_10.42.42.2(pid=20197): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20197)] 12:27:02.342288 run osmo-hlr_10.42.42.2(pid=20197): stdout: | (launched: 2022-12-13_12:26:58.753366) 12:27:02.392571 run osmo-hlr_10.42.42.2(pid=20197): stderr: | 20221213122658926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122658926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122658926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122658926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122658926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122658927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122658940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122658948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122658948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122658948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:02.462098 run osmo-msc_10.42.42.6(pid=20203): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20203)] 12:27:02.510100 run osmo-msc_10.42.42.6(pid=20203): stdout: | (launched: 2022-12-13_12:27:00.793061) 12:27:02.559742 run osmo-msc_10.42.42.6(pid=20203): stderr: | 20221213122701301 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122701301 DLGLOBAL DEBUG validating counter group 0x7f2fb5878c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122701301 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122701301 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122701301 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122701301 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122701303 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122701303 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122701304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122701304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:02.609539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20196): Terminating (SIGTERM) 12:27:02.649270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20199): Terminating (SIGTERM) 12:27:02.689130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20202): Terminating (SIGTERM) 12:27:02.729162 --- ParallelTerminationStrategy: PID 20196 died... 12:27:02.748020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20196): Terminated: ok {rc=0} 12:27:02.792141 --- ParallelTerminationStrategy: PID 20199 died... 12:27:02.810874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20199): Terminated: ok {rc=0} 12:27:02.854905 --- ParallelTerminationStrategy: PID 20202 died... 12:27:02.873868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20202): Terminated: ok {rc=0} 12:27:02.957651 bus /sierra_3: Setting Powered False 12:27:04.052668 bus /sierra_3: Setting Powered False 12:27:05.167307 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:27:06.414963 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:06.421687 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:27:06.451017 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:27:06.478224 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:27:06.529114 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:27:06.558353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:27:06.585108 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:27:07.141900 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:27:07.190633 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:07.202188 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:27:07.266776 tst mo_mt_call.py: using LAC 33938 12:27:07.384897 tst mo_mt_call.py: using RAC 23 12:27:07.502679 tst mo_mt_call.py: using CellId 33938 12:27:07.621608 tst mo_mt_call.py: using BVCI 33939 12:27:07.731243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:07.743084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:07.754417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:07.765801 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:07.777299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:07.788719 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:27:07.908318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:27:08.024307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:08.494391 run create_hlr_db(pid=20208): Launched 12:27:08.617795 bus /sierra_2: Setting Powered False 12:27:09.678818 run create_hlr_db(pid=20208): Terminated: ok {rc=0} 12:27:10.123761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20210): Launched 12:27:10.449908 run osmo-hlr_10.42.42.2(pid=20211): Launched 12:27:10.574732 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:11.139076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20213): Launched 12:27:11.464841 run osmo-stp_10.42.42.5(pid=20214): Launched 12:27:11.590350 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:12.179197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20216): Launched 12:27:12.505342 run osmo-msc_10.42.42.6(pid=20217): Launched 12:27:12.687978 run osmo-stp_10.42.42.5(pid=20214): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20214)] 12:27:12.826998 run osmo-stp_10.42.42.5(pid=20214): stdout: | (launched: 2022-12-13_12:27:11.405185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:12.965310 run osmo-stp_10.42.42.5(pid=20214): stderr: | 20221213122711595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122711595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122711595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122711595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122711596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122711596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122711596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:13.102298 run osmo-stp_10.42.42.5(pid=20214): stdout: | (launched: 2022-12-13_12:27:11.405185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:13.232402 run osmo-stp_10.42.42.5(pid=20214): stderr: | 20221213122711595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122711595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122711595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122711595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122711596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122711596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122711596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:13.388374 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20214): Process ended prematurely: osmo-stp_10.42.42.5(pid=20214) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20214)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:27:13.398278 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:27:13.426423 run osmo-hlr_10.42.42.2(pid=20211): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20211)] 12:27:13.477571 run osmo-hlr_10.42.42.2(pid=20211): stdout: | (launched: 2022-12-13_12:27:10.390456) 12:27:13.530478 run osmo-hlr_10.42.42.2(pid=20211): stderr: | 20221213122710586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122710586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122710586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122710586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122710586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122710586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122710600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122710610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122710610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122710610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:13.604823 run osmo-msc_10.42.42.6(pid=20217): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20217)] 12:27:13.655613 run osmo-msc_10.42.42.6(pid=20217): stdout: | (launched: 2022-12-13_12:27:12.445608) 12:27:13.708215 run osmo-msc_10.42.42.6(pid=20217): stderr: | 20221213122712765 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122712765 DLGLOBAL DEBUG validating counter group 0x7fe54f6b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122712765 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122712765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122712766 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122712766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122712767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122712768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122712768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122712768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:13.761401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20210): Terminating (SIGTERM) 12:27:13.803328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20213): Terminating (SIGTERM) 12:27:13.845901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20216): Terminating (SIGTERM) 12:27:13.888692 --- ParallelTerminationStrategy: PID 20210 died... 12:27:13.909384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20210): Terminated: ok {rc=0} 12:27:13.956691 --- ParallelTerminationStrategy: PID 20213 died... 12:27:13.976908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20213): Terminated: ok {rc=0} 12:27:14.023907 --- ParallelTerminationStrategy: PID 20216 died... 12:27:14.044160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20216): Terminated: ok {rc=0} 12:27:14.133836 bus /sierra_3: Setting Powered False 12:27:15.232156 bus /sierra_3: Setting Powered False 12:27:16.346499 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:27:17.490736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:17.502693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:27:17.568042 tst mo_mt_call_osmux.py: using LAC 33939 12:27:17.687913 tst mo_mt_call_osmux.py: using RAC 24 12:27:17.809311 tst mo_mt_call_osmux.py: using CellId 33939 12:27:17.928339 tst mo_mt_call_osmux.py: using BVCI 33940 12:27:18.038541 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:18.049912 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:18.061026 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:18.072142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:18.083385 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:18.094568 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:27:18.214873 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:27:18.333371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:18.803341 run create_hlr_db(pid=20219): Launched 12:27:18.926878 bus /sierra_2: Setting Powered False 12:27:19.990898 run create_hlr_db(pid=20219): Terminated: ok {rc=0} 12:27:20.424525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20221): Launched 12:27:20.728833 run osmo-hlr_10.42.42.2(pid=20222): Launched 12:27:20.843207 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:21.365323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20224): Launched 12:27:21.668775 run osmo-stp_10.42.42.5(pid=20225): Launched 12:27:21.783793 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:22.335090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20227): Launched 12:27:22.640427 run osmo-msc_10.42.42.6(pid=20228): Launched 12:27:22.811366 run osmo-stp_10.42.42.5(pid=20225): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20225)] 12:27:22.940374 run osmo-stp_10.42.42.5(pid=20225): stdout: | (launched: 2022-12-13_12:27:21.612732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:23.069318 run osmo-stp_10.42.42.5(pid=20225): stderr: | 20221213122721780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122721780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122721780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122721781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122721781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122721782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122721782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:23.195902 run osmo-stp_10.42.42.5(pid=20225): stdout: | (launched: 2022-12-13_12:27:21.612732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:23.316469 run osmo-stp_10.42.42.5(pid=20225): stderr: | 20221213122721780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122721780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122721780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122721781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122721781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122721782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122721782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:23.461549 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20225): Process ended prematurely: osmo-stp_10.42.42.5(pid=20225) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20225)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:27:23.470494 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:27:23.497243 run osmo-hlr_10.42.42.2(pid=20222): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20222)] 12:27:23.544766 run osmo-hlr_10.42.42.2(pid=20222): stdout: | (launched: 2022-12-13_12:27:20.672448) 12:27:23.594188 run osmo-hlr_10.42.42.2(pid=20222): stderr: | 20221213122720848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122720848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122720848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122720848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122720848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122720848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122720861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122720870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122720870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122720870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:23.663464 run osmo-msc_10.42.42.6(pid=20228): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20228)] 12:27:23.710861 run osmo-msc_10.42.42.6(pid=20228): stdout: | (launched: 2022-12-13_12:27:22.583968) 12:27:23.760032 run osmo-msc_10.42.42.6(pid=20228): stderr: | 20221213122722852 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122722852 DLGLOBAL DEBUG validating counter group 0x7f9ba8cc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122722852 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122722852 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122722853 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122722853 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122722855 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122722855 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122722855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122722855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:23.809546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20221): Terminating (SIGTERM) 12:27:23.850443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20224): Terminating (SIGTERM) 12:27:23.890252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20227): Terminating (SIGTERM) 12:27:23.930575 --- ParallelTerminationStrategy: PID 20221 died... 12:27:23.949761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20221): Terminated: ok {rc=0} 12:27:23.993902 --- ParallelTerminationStrategy: PID 20224 died... 12:27:24.012527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20224): Terminated: ok {rc=0} 12:27:24.056896 --- ParallelTerminationStrategy: PID 20227 died... 12:27:24.075835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20227): Terminated: ok {rc=0} 12:27:24.160917 bus /sierra_3: Setting Powered False 12:27:25.257195 bus /sierra_3: Setting Powered False 12:27:26.371571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:27:27.617338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:27.623583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:27:27.652466 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:27:27.679235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:27:27.731416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:27:27.761824 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:27:27.790255 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:27:28.339327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:27:28.395183 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:28.407193 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:27:28.477743 tst mo_mt_call.py: using LAC 33940 12:27:28.604836 tst mo_mt_call.py: using RAC 25 12:27:28.730659 tst mo_mt_call.py: using CellId 33940 12:27:28.855821 tst mo_mt_call.py: using BVCI 33941 12:27:28.966370 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:28.977821 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:28.988909 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:29.000258 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:29.011660 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:29.023017 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:27:29.142580 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:27:29.257325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:29.730361 run create_hlr_db(pid=20233): Launched 12:27:29.856519 bus /sierra_2: Setting Powered False 12:27:30.923574 run create_hlr_db(pid=20233): Terminated: ok {rc=0} 12:27:31.388458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20235): Launched 12:27:31.770213 run osmo-hlr_10.42.42.2(pid=20236): Launched 12:27:32.077306 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:32.626664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20238): Launched 12:27:32.930631 run osmo-stp_10.42.42.5(pid=20239): Launched 12:27:33.046444 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:33.598170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20241): Launched 12:27:33.902541 run osmo-msc_10.42.42.6(pid=20242): Launched 12:27:34.071829 run osmo-stp_10.42.42.5(pid=20239): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20239)] 12:27:34.199527 run osmo-stp_10.42.42.5(pid=20239): stdout: | (launched: 2022-12-13_12:27:32.874888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:34.327730 run osmo-stp_10.42.42.5(pid=20239): stderr: | 20221213122733041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122733041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122733041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122733042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122733042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122733042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122733042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:34.454274 run osmo-stp_10.42.42.5(pid=20239): stdout: | (launched: 2022-12-13_12:27:32.874888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:34.574765 run osmo-stp_10.42.42.5(pid=20239): stderr: | 20221213122733041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122733041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122733041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122733042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122733042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122733042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122733042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:34.719226 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20239): Process ended prematurely: osmo-stp_10.42.42.5(pid=20239) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20239)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:27:34.728114 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:27:34.754477 run osmo-hlr_10.42.42.2(pid=20236): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20236)] 12:27:34.801345 run osmo-hlr_10.42.42.2(pid=20236): stdout: | (launched: 2022-12-13_12:27:31.706759) 12:27:34.850099 run osmo-hlr_10.42.42.2(pid=20236): stderr: | 20221213122731975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122731975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122731975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122731975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122731975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122731975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122732000 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122732008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122732009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122732009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:34.918308 run osmo-msc_10.42.42.6(pid=20242): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20242)] 12:27:34.965108 run osmo-msc_10.42.42.6(pid=20242): stdout: | (launched: 2022-12-13_12:27:33.846114) 12:27:35.013562 run osmo-msc_10.42.42.6(pid=20242): stderr: | 20221213122734114 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122734114 DLGLOBAL DEBUG validating counter group 0x7f39d6ab0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122734114 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122734114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122734114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122734115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122734116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122734117 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122734117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122734117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:35.062322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20235): Terminating (SIGTERM) 12:27:35.101671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20238): Terminating (SIGTERM) 12:27:35.141083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20241): Terminating (SIGTERM) 12:27:35.180706 --- ParallelTerminationStrategy: PID 20235 died... 12:27:35.199792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20235): Terminated: ok {rc=0} 12:27:35.243224 --- ParallelTerminationStrategy: PID 20238 died... 12:27:35.261734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20238): Terminated: ok {rc=0} 12:27:35.305287 --- ParallelTerminationStrategy: PID 20241 died... 12:27:35.323677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20241): Terminated: ok {rc=0} 12:27:35.408517 bus /sierra_3: Setting Powered False 12:27:36.507691 bus /sierra_3: Setting Powered False 12:27:37.623137 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:27:38.773543 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:38.786066 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:27:38.854620 tst mo_mt_call_osmux.py: using LAC 33941 12:27:38.983449 tst mo_mt_call_osmux.py: using RAC 26 12:27:39.110622 tst mo_mt_call_osmux.py: using CellId 33941 12:27:39.240031 tst mo_mt_call_osmux.py: using BVCI 33942 12:27:39.358503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:39.370487 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:39.382139 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:39.393802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:39.406038 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:39.418192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:27:39.535254 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:27:39.657848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:40.164552 run create_hlr_db(pid=20244): Launched 12:27:40.287921 bus /sierra_2: Setting Powered False 12:27:41.352779 run create_hlr_db(pid=20244): Terminated: ok {rc=0} 12:27:41.804447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20246): Launched 12:27:42.129643 run osmo-hlr_10.42.42.2(pid=20247): Launched 12:27:42.254218 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:42.815957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20249): Launched 12:27:43.142201 run osmo-stp_10.42.42.5(pid=20250): Launched 12:27:43.267907 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:43.856193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20252): Launched 12:27:44.182978 run osmo-msc_10.42.42.6(pid=20253): Launched 12:27:44.367201 run osmo-stp_10.42.42.5(pid=20250): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20250)] 12:27:44.504366 run osmo-stp_10.42.42.5(pid=20250): stdout: | (launched: 2022-12-13_12:27:43.081865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:44.642278 run osmo-stp_10.42.42.5(pid=20250): stderr: | 20221213122743269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122743270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122743270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122743270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122743271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122743271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122743271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:44.778150 run osmo-stp_10.42.42.5(pid=20250): stdout: | (launched: 2022-12-13_12:27:43.081865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:44.907657 run osmo-stp_10.42.42.5(pid=20250): stderr: | 20221213122743269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122743270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122743270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122743270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122743271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122743271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122743271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:45.062619 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20250): Process ended prematurely: osmo-stp_10.42.42.5(pid=20250) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20250)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:27:45.072318 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:27:45.100801 run osmo-hlr_10.42.42.2(pid=20247): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20247)] 12:27:45.151813 run osmo-hlr_10.42.42.2(pid=20247): stdout: | (launched: 2022-12-13_12:27:42.069693) 12:27:45.203804 run osmo-hlr_10.42.42.2(pid=20247): stderr: | 20221213122742263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122742263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122742263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122742263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122742263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122742263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122742275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122742284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122742284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122742284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:45.276567 run osmo-msc_10.42.42.6(pid=20253): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20253)] 12:27:45.326721 run osmo-msc_10.42.42.6(pid=20253): stdout: | (launched: 2022-12-13_12:27:44.123456) 12:27:45.379281 run osmo-msc_10.42.42.6(pid=20253): stderr: | 20221213122744439 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122744439 DLGLOBAL DEBUG validating counter group 0x7f72733b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122744439 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122744440 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122744440 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122744440 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122744442 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122744442 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122744442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122744442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:45.432011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20246): Terminating (SIGTERM) 12:27:45.474135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20249): Terminating (SIGTERM) 12:27:45.516562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20252): Terminating (SIGTERM) 12:27:45.559409 --- ParallelTerminationStrategy: PID 20246 died... 12:27:45.579872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20246): Terminated: ok {rc=0} 12:27:45.626709 --- ParallelTerminationStrategy: PID 20249 died... 12:27:45.647007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20249): Terminated: ok {rc=0} 12:27:45.693750 --- ParallelTerminationStrategy: PID 20252 died... 12:27:45.713949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20252): Terminated: ok {rc=0} 12:27:45.801911 bus /sierra_3: Setting Powered False 12:27:46.914737 bus /sierra_3: Setting Powered False 12:27:48.043669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:27:49.292414 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:49.299394 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:27:49.329730 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:27:49.359040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:27:49.418037 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:27:49.447309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:27:49.474247 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:27:50.024093 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:27:50.077978 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:27:50.090342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:27:50.158990 tst mo_mt_call.py: using LAC 33942 12:27:50.290022 tst mo_mt_call.py: using RAC 27 12:27:50.417355 tst mo_mt_call.py: using CellId 33942 12:27:50.542379 tst mo_mt_call.py: using BVCI 33943 12:27:50.660413 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:27:50.672150 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:27:50.683737 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:27:50.695232 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:27:50.707236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:27:50.719070 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:27:50.837196 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:27:50.954342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:51.425669 run create_hlr_db(pid=20258): Launched 12:27:51.551184 bus /sierra_2: Setting Powered False 12:27:52.612088 run create_hlr_db(pid=20258): Terminated: ok {rc=0} 12:27:53.057723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20260): Launched 12:27:53.384785 run osmo-hlr_10.42.42.2(pid=20261): Launched 12:27:53.509041 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:54.072410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20263): Launched 12:27:54.400399 run osmo-stp_10.42.42.5(pid=20264): Launched 12:27:54.525191 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:55.113145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20266): Launched 12:27:55.438846 run osmo-msc_10.42.42.6(pid=20267): Launched 12:27:55.623009 run osmo-stp_10.42.42.5(pid=20264): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20264)] 12:27:55.760485 run osmo-stp_10.42.42.5(pid=20264): stdout: | (launched: 2022-12-13_12:27:54.341244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:55.898331 run osmo-stp_10.42.42.5(pid=20264): stderr: | 20221213122754529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122754529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122754530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122754530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122754530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122754530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122754531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:56.034496 run osmo-stp_10.42.42.5(pid=20264): stdout: | (launched: 2022-12-13_12:27:54.341244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:56.164844 run osmo-stp_10.42.42.5(pid=20264): stderr: | 20221213122754529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122754529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122754530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122754530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122754530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122754530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122754531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:56.320198 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20264): Process ended prematurely: osmo-stp_10.42.42.5(pid=20264) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20264)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:27:56.330124 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:27:56.357844 run osmo-hlr_10.42.42.2(pid=20261): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20261)] 12:27:56.408120 run osmo-hlr_10.42.42.2(pid=20261): stdout: | (launched: 2022-12-13_12:27:53.325136) 12:27:56.460177 run osmo-hlr_10.42.42.2(pid=20261): stderr: | 20221213122753520 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122753520 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122753520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122753520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122753520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122753520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122753538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122753547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122753547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122753547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:56.532693 run osmo-msc_10.42.42.6(pid=20267): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20267)] 12:27:56.582292 run osmo-msc_10.42.42.6(pid=20267): stdout: | (launched: 2022-12-13_12:27:55.379912) 12:27:56.633894 run osmo-msc_10.42.42.6(pid=20267): stderr: | 20221213122755697 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122755697 DLGLOBAL DEBUG validating counter group 0x7f6516faec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122755697 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122755697 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122755697 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122755698 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122755699 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122755700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122755700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122755700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:56.686462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20260): Terminating (SIGTERM) 12:27:56.728136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20263): Terminating (SIGTERM) 12:27:56.770560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20266): Terminating (SIGTERM) 12:27:56.812880 --- ParallelTerminationStrategy: PID 20260 died... 12:27:56.833420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20260): Terminated: ok {rc=0} 12:27:56.879791 --- ParallelTerminationStrategy: PID 20263 died... 12:27:56.899514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20263): Terminated: ok {rc=0} 12:27:56.946137 --- ParallelTerminationStrategy: PID 20266 died... 12:27:56.966076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20266): Terminated: ok {rc=0} 12:27:57.054215 bus /sierra_3: Setting Powered False 12:27:58.153761 bus /sierra_3: Setting Powered False 12:27:59.272728 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:28:00.417386 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:28:00.429476 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:28:00.495140 tst mo_mt_call_osmux.py: using LAC 33943 12:28:00.615265 tst mo_mt_call_osmux.py: using RAC 28 12:28:00.736487 tst mo_mt_call_osmux.py: using CellId 33943 12:28:00.862361 tst mo_mt_call_osmux.py: using BVCI 33944 12:28:00.983295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:28:00.995118 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:28:01.007234 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:28:01.019244 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:28:01.031466 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:28:01.043509 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:28:01.179936 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:28:01.297607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:01.812079 run create_hlr_db(pid=20269): Launched 12:28:01.962446 bus /sierra_2: Setting Powered False 12:28:03.022941 run create_hlr_db(pid=20269): Terminated: ok {rc=0} 12:28:03.447285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20271): Launched 12:28:03.750574 run osmo-hlr_10.42.42.2(pid=20272): Launched 12:28:03.865225 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:04.407618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20274): Launched 12:28:04.712662 run osmo-stp_10.42.42.5(pid=20275): Launched 12:28:04.827665 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:05.377540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20277): Launched 12:28:05.682902 run osmo-msc_10.42.42.6(pid=20278): Launched 12:28:05.852356 run osmo-stp_10.42.42.5(pid=20275): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20275)] 12:28:05.979844 run osmo-stp_10.42.42.5(pid=20275): stdout: | (launched: 2022-12-13_12:28:04.656658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:06.107826 run osmo-stp_10.42.42.5(pid=20275): stderr: | 20221213122804824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122804824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122804825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122804825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122804826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122804826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122804826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:06.234513 run osmo-stp_10.42.42.5(pid=20275): stdout: | (launched: 2022-12-13_12:28:04.656658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:06.355217 run osmo-stp_10.42.42.5(pid=20275): stderr: | 20221213122804824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122804824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122804825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122804825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122804826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122804826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122804826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:06.499458 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20275): Process ended prematurely: osmo-stp_10.42.42.5(pid=20275) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20275)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:28:06.508389 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:28:06.534971 run osmo-hlr_10.42.42.2(pid=20272): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20272)] 12:28:06.583063 run osmo-hlr_10.42.42.2(pid=20272): stdout: | (launched: 2022-12-13_12:28:03.694743) 12:28:06.632293 run osmo-hlr_10.42.42.2(pid=20272): stderr: | 20221213122803868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122803868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122803868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122803868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122803868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122803868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122803880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122803891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122803891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122803891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:06.701137 run osmo-msc_10.42.42.6(pid=20278): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20278)] 12:28:06.748338 run osmo-msc_10.42.42.6(pid=20278): stdout: | (launched: 2022-12-13_12:28:05.626585) 12:28:06.797487 run osmo-msc_10.42.42.6(pid=20278): stderr: | 20221213122805896 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122805896 DLGLOBAL DEBUG validating counter group 0x7f1cea060c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122805896 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122805897 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122805897 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122805897 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122805899 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122805899 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122805899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122805899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:06.847050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20271): Terminating (SIGTERM) 12:28:06.886623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20274): Terminating (SIGTERM) 12:28:06.926288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20277): Terminating (SIGTERM) 12:28:06.966359 --- ParallelTerminationStrategy: PID 20271 died... 12:28:06.985430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20271): Terminated: ok {rc=0} 12:28:07.029369 --- ParallelTerminationStrategy: PID 20274 died... 12:28:07.048006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20274): Terminated: ok {rc=0} 12:28:07.091647 --- ParallelTerminationStrategy: PID 20277 died... 12:28:07.110408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20277): Terminated: ok {rc=0} 12:28:07.193522 bus /sierra_3: Setting Powered False 12:28:08.291114 bus /sierra_3: Setting Powered False 12:28:09.409924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:28:10.662622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:28:10.669163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:28:10.698225 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:28:10.724838 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:28:10.775107 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:28:10.804304 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:28:10.831231 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:28:11.393612 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:28:11.443350 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:11.454760 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:28:11.520456 tst mo_mt_call.py: using LAC 33944 12:28:11.639337 tst mo_mt_call.py: using RAC 29 12:28:11.760941 tst mo_mt_call.py: using CellId 33944 12:28:11.881044 tst mo_mt_call.py: using BVCI 33945 12:28:11.991600 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:12.003047 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:12.014365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:12.025435 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:12.037143 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:12.048881 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:28:12.169231 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:28:12.287689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:12.761502 run create_hlr_db(pid=20283): Launched 12:28:12.885735 bus /sierra_2: Setting Powered False 12:28:13.946596 run create_hlr_db(pid=20283): Terminated: ok {rc=0} 12:28:14.391376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20285): Launched 12:28:14.717763 run osmo-hlr_10.42.42.2(pid=20286): Launched 12:28:14.841649 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:15.406509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20288): Launched 12:28:15.732408 run osmo-stp_10.42.42.5(pid=20289): Launched 12:28:15.929777 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:16.731729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20291): Launched 12:28:17.057297 run osmo-msc_10.42.42.6(pid=20292): Launched 12:28:17.320922 run osmo-stp_10.42.42.5(pid=20289): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20289)] 12:28:17.459847 run osmo-stp_10.42.42.5(pid=20289): stdout: | (launched: 2022-12-13_12:28:15.673301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:17.599868 run osmo-stp_10.42.42.5(pid=20289): stderr: | 20221213122815924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122815929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122815929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122815930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122815930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122815930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122815930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:17.735902 run osmo-stp_10.42.42.5(pid=20289): stdout: | (launched: 2022-12-13_12:28:15.673301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:17.866301 run osmo-stp_10.42.42.5(pid=20289): stderr: | 20221213122815924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122815929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122815929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122815930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122815930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122815930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122815930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:18.022010 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20289): Process ended prematurely: osmo-stp_10.42.42.5(pid=20289) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20289)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:28:18.031844 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:28:18.060008 run osmo-hlr_10.42.42.2(pid=20286): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20286)] 12:28:18.111636 run osmo-hlr_10.42.42.2(pid=20286): stdout: | (launched: 2022-12-13_12:28:14.658344) 12:28:18.164032 run osmo-hlr_10.42.42.2(pid=20286): stderr: | 20221213122814852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122814852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122814852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122814852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122814852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122814852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122814863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122814873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122814873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122814873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:18.237409 run osmo-msc_10.42.42.6(pid=20292): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20292)] 12:28:18.287733 run osmo-msc_10.42.42.6(pid=20292): stdout: | (launched: 2022-12-13_12:28:17.000860) 12:28:18.340556 run osmo-msc_10.42.42.6(pid=20292): stderr: | 20221213122817398 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122817398 DLGLOBAL DEBUG validating counter group 0x7f6b7d544c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122817398 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122817398 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122817398 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122817398 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122817400 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122817400 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122817400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122817401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:18.393281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20285): Terminating (SIGTERM) 12:28:18.435393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20288): Terminating (SIGTERM) 12:28:18.478210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20291): Terminating (SIGTERM) 12:28:18.520885 --- ParallelTerminationStrategy: PID 20285 died... 12:28:18.541684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20285): Terminated: ok {rc=0} 12:28:18.588687 --- ParallelTerminationStrategy: PID 20288 died... 12:28:18.608936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20288): Terminated: ok {rc=0} 12:28:18.655609 --- ParallelTerminationStrategy: PID 20291 died... 12:28:18.675667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20291): Terminated: ok {rc=0} 12:28:18.765259 bus /sierra_3: Setting Powered False 12:28:19.864607 bus /sierra_3: Setting Powered False 12:28:20.983283 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:28:22.129931 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:22.141923 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:28:22.208360 tst mo_mt_call_osmux.py: using LAC 33945 12:28:22.328589 tst mo_mt_call_osmux.py: using RAC 30 12:28:22.448595 tst mo_mt_call_osmux.py: using CellId 33945 12:28:22.568221 tst mo_mt_call_osmux.py: using BVCI 33946 12:28:22.679008 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:22.690339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:22.701549 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:22.712566 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:22.723792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:22.734871 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:28:22.857449 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:28:22.978317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:23.482436 run create_hlr_db(pid=20294): Launched 12:28:23.607657 bus /sierra_2: Setting Powered False 12:28:24.671651 run create_hlr_db(pid=20294): Terminated: ok {rc=0} 12:28:25.106781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20296): Launched 12:28:25.411139 run osmo-hlr_10.42.42.2(pid=20297): Launched 12:28:25.529055 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:26.050124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20299): Launched 12:28:26.354984 run osmo-stp_10.42.42.5(pid=20300): Launched 12:28:26.470749 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:27.019446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20302): Launched 12:28:27.324051 run osmo-msc_10.42.42.6(pid=20303): Launched 12:28:27.493582 run osmo-stp_10.42.42.5(pid=20300): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20300)] 12:28:27.620885 run osmo-stp_10.42.42.5(pid=20300): stdout: | (launched: 2022-12-13_12:28:26.297265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:27.748369 run osmo-stp_10.42.42.5(pid=20300): stderr: | 20221213122826464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122826464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122826464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122826465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122826465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122826465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122826465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:27.874108 run osmo-stp_10.42.42.5(pid=20300): stdout: | (launched: 2022-12-13_12:28:26.297265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:27.994266 run osmo-stp_10.42.42.5(pid=20300): stderr: | 20221213122826464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122826464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122826464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122826465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122826465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122826465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122826465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:28.138763 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20300): Process ended prematurely: osmo-stp_10.42.42.5(pid=20300) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20300)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:28:28.147689 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:28:28.174069 run osmo-hlr_10.42.42.2(pid=20297): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20297)] 12:28:28.221109 run osmo-hlr_10.42.42.2(pid=20297): stdout: | (launched: 2022-12-13_12:28:25.354824) 12:28:28.270000 run osmo-hlr_10.42.42.2(pid=20297): stderr: | 20221213122825526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122825526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122825527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122825527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122825527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122825527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122825537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122825546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122825546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122825546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:28.338858 run osmo-msc_10.42.42.6(pid=20303): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20303)] 12:28:28.386660 run osmo-msc_10.42.42.6(pid=20303): stdout: | (launched: 2022-12-13_12:28:27.268247) 12:28:28.435525 run osmo-msc_10.42.42.6(pid=20303): stderr: | 20221213122827537 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122827537 DLGLOBAL DEBUG validating counter group 0x7fa41d5a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122827537 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122827537 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122827537 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122827537 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122827539 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122827539 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122827540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122827540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:28.484771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20296): Terminating (SIGTERM) 12:28:28.523843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20299): Terminating (SIGTERM) 12:28:28.562946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20302): Terminating (SIGTERM) 12:28:28.602626 --- ParallelTerminationStrategy: PID 20296 died... 12:28:28.621662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20296): Terminated: ok {rc=0} 12:28:28.665235 --- ParallelTerminationStrategy: PID 20299 died... 12:28:28.683725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20299): Terminated: ok {rc=0} 12:28:28.726992 --- ParallelTerminationStrategy: PID 20302 died... 12:28:28.745550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20302): Terminated: ok {rc=0} 12:28:28.830852 bus /sierra_3: Setting Powered False 12:28:29.927640 bus /sierra_3: Setting Powered False 12:28:31.048334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:28:32.313122 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:28:32.319950 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:28:32.350157 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:28:32.378759 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:28:32.433133 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:28:32.463935 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:28:32.491918 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:28:33.042913 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:28:33.092207 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:33.103886 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:28:33.170219 tst mo_mt_call.py: using LAC 33946 12:28:33.288942 tst mo_mt_call.py: using RAC 31 12:28:33.409053 tst mo_mt_call.py: using CellId 33946 12:28:33.529628 tst mo_mt_call.py: using BVCI 33947 12:28:33.639254 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:33.650863 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:33.662335 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:33.674400 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:33.685775 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:33.697231 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:33.815961 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:33.932026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:34.406393 run create_hlr_db(pid=20308): Launched 12:28:34.531415 bus /sierra_2: Setting Powered False 12:28:35.592535 run create_hlr_db(pid=20308): Terminated: ok {rc=0} 12:28:36.039628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20310): Launched 12:28:36.366582 run osmo-hlr_10.42.42.2(pid=20311): Launched 12:28:36.490523 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:37.049529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20313): Launched 12:28:37.377507 run osmo-stp_10.42.42.5(pid=20314): Launched 12:28:37.505594 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:38.096057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20316): Launched 12:28:38.424792 run osmo-msc_10.42.42.6(pid=20317): Launched 12:28:38.608470 run osmo-stp_10.42.42.5(pid=20314): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20314)] 12:28:38.745971 run osmo-stp_10.42.42.5(pid=20314): stdout: | (launched: 2022-12-13_12:28:37.317838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:38.884118 run osmo-stp_10.42.42.5(pid=20314): stderr: | 20221213122837505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122837505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122837506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122837506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122837506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122837507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122837507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:39.019956 run osmo-stp_10.42.42.5(pid=20314): stdout: | (launched: 2022-12-13_12:28:37.317838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:39.150238 run osmo-stp_10.42.42.5(pid=20314): stderr: | 20221213122837505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122837505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122837506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122837506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122837506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122837507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122837507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:39.305960 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20314): Process ended prematurely: osmo-stp_10.42.42.5(pid=20314) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20314)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:28:39.315589 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:28:39.343506 run osmo-hlr_10.42.42.2(pid=20311): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20311)] 12:28:39.393830 run osmo-hlr_10.42.42.2(pid=20311): stdout: | (launched: 2022-12-13_12:28:36.306669) 12:28:39.445510 run osmo-hlr_10.42.42.2(pid=20311): stderr: | 20221213122836501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122836501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122836501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122836501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122836501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122836501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122836513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122836522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122836522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122836522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:39.518040 run osmo-msc_10.42.42.6(pid=20317): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20317)] 12:28:39.567752 run osmo-msc_10.42.42.6(pid=20317): stdout: | (launched: 2022-12-13_12:28:38.365569) 12:28:39.619359 run osmo-msc_10.42.42.6(pid=20317): stderr: | 20221213122838685 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122838685 DLGLOBAL DEBUG validating counter group 0x7f2b8601ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122838685 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122838685 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122838685 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122838686 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122838687 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122838688 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122838688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122838688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:39.671846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20310): Terminating (SIGTERM) 12:28:39.713030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20313): Terminating (SIGTERM) 12:28:39.754456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20316): Terminating (SIGTERM) 12:28:39.796467 --- ParallelTerminationStrategy: PID 20310 died... 12:28:39.816772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20310): Terminated: ok {rc=0} 12:28:39.862945 --- ParallelTerminationStrategy: PID 20313 died... 12:28:39.882807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20313): Terminated: ok {rc=0} 12:28:39.929084 --- ParallelTerminationStrategy: PID 20316 died... 12:28:39.948854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20316): Terminated: ok {rc=0} 12:28:40.036184 bus /sierra_3: Setting Powered False 12:28:41.134658 bus /sierra_3: Setting Powered False 12:28:42.248935 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:28:43.398276 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:43.410756 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:28:43.479116 tst mo_mt_call_osmux.py: using LAC 33947 12:28:43.606825 tst mo_mt_call_osmux.py: using RAC 32 12:28:43.734190 tst mo_mt_call_osmux.py: using CellId 33947 12:28:43.864178 tst mo_mt_call_osmux.py: using BVCI 33948 12:28:43.982707 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:43.994632 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:44.006491 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:44.018217 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:44.030323 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:44.042303 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:44.162763 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:44.283640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:44.788452 run create_hlr_db(pid=20319): Launched 12:28:44.912044 bus /sierra_2: Setting Powered False 12:28:45.982255 run create_hlr_db(pid=20319): Terminated: ok {rc=0} 12:28:46.426134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20321): Launched 12:28:46.764529 run osmo-hlr_10.42.42.2(pid=20322): Launched 12:28:46.920426 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:47.589488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20324): Launched 12:28:47.917053 run osmo-stp_10.42.42.5(pid=20325): Launched 12:28:48.042528 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:48.630519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20327): Launched 12:28:48.956451 run osmo-msc_10.42.42.6(pid=20328): Launched 12:28:49.138517 run osmo-stp_10.42.42.5(pid=20325): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20325)] 12:28:49.275541 run osmo-stp_10.42.42.5(pid=20325): stdout: | (launched: 2022-12-13_12:28:47.857382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:49.413258 run osmo-stp_10.42.42.5(pid=20325): stderr: | 20221213122848047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122848047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122848047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122848048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122848048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122848048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122848048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:49.549069 run osmo-stp_10.42.42.5(pid=20325): stdout: | (launched: 2022-12-13_12:28:47.857382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:49.678400 run osmo-stp_10.42.42.5(pid=20325): stderr: | 20221213122848047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122848047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122848047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122848048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122848048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122848048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122848048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:49.833242 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20325): Process ended prematurely: osmo-stp_10.42.42.5(pid=20325) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20325)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:28:49.842951 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:28:49.870894 run osmo-hlr_10.42.42.2(pid=20322): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20322)] 12:28:49.921455 run osmo-hlr_10.42.42.2(pid=20322): stdout: | (launched: 2022-12-13_12:28:46.699061) 12:28:49.973171 run osmo-hlr_10.42.42.2(pid=20322): stderr: | 20221213122847080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122847082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122847083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122847083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122847083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122847083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122847103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122847127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122847127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122847127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:50.045445 run osmo-msc_10.42.42.6(pid=20328): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20328)] 12:28:50.094884 run osmo-msc_10.42.42.6(pid=20328): stdout: | (launched: 2022-12-13_12:28:48.897395) 12:28:50.147078 run osmo-msc_10.42.42.6(pid=20328): stderr: | 20221213122849213 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122849213 DLGLOBAL DEBUG validating counter group 0x7f2849410c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122849213 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122849214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122849214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122849214 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122849216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122849216 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122849216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122849216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:50.198736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20321): Terminating (SIGTERM) 12:28:50.240497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20324): Terminating (SIGTERM) 12:28:50.282783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20327): Terminating (SIGTERM) 12:28:50.324830 --- ParallelTerminationStrategy: PID 20321 died... 12:28:50.345268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20321): Terminated: ok {rc=0} 12:28:50.391527 --- ParallelTerminationStrategy: PID 20324 died... 12:28:50.411431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20324): Terminated: ok {rc=0} 12:28:50.457490 --- ParallelTerminationStrategy: PID 20327 died... 12:28:50.477362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20327): Terminated: ok {rc=0} 12:28:50.564797 bus /sierra_3: Setting Powered False 12:28:51.662018 bus /sierra_3: Setting Powered False 12:28:52.774300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:28:54.027789 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:28:54.034505 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:28:54.063341 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:28:54.089912 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:28:54.142080 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:28:54.172092 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:28:54.199932 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:28:54.748384 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:28:54.797891 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:28:54.809202 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:28:54.875574 tst mo_mt_call.py: using LAC 33948 12:28:54.995064 tst mo_mt_call.py: using RAC 33 12:28:55.115638 tst mo_mt_call.py: using CellId 33948 12:28:55.236243 tst mo_mt_call.py: using BVCI 33949 12:28:55.347461 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:28:55.358668 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:28:55.369606 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:28:55.380424 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:28:55.391378 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:28:55.402374 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:28:55.522813 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:28:55.637983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:56.109966 run create_hlr_db(pid=20333): Launched 12:28:56.234266 bus /sierra_2: Setting Powered False 12:28:57.295384 run create_hlr_db(pid=20333): Terminated: ok {rc=0} 12:28:57.719375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20335): Launched 12:28:58.023747 run osmo-hlr_10.42.42.2(pid=20336): Launched 12:28:58.139377 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:58.662317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20338): Launched 12:28:58.966459 run osmo-stp_10.42.42.5(pid=20339): Launched 12:28:59.084002 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:59.634570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20341): Launched 12:28:59.942875 run osmo-msc_10.42.42.6(pid=20342): Launched 12:29:00.113822 run osmo-stp_10.42.42.5(pid=20339): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20339)] 12:29:00.242393 run osmo-stp_10.42.42.5(pid=20339): stdout: | (launched: 2022-12-13_12:28:58.910501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:00.370923 run osmo-stp_10.42.42.5(pid=20339): stderr: | 20221213122859076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122859076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122859076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122859077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122859077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122859078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122859078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:00.497653 run osmo-stp_10.42.42.5(pid=20339): stdout: | (launched: 2022-12-13_12:28:58.910501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:00.620298 run osmo-stp_10.42.42.5(pid=20339): stderr: | 20221213122859076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122859076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122859076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122859077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122859077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122859078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122859078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:00.765651 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20339): Process ended prematurely: osmo-stp_10.42.42.5(pid=20339) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20339)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:29:00.774520 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:29:00.801198 run osmo-hlr_10.42.42.2(pid=20336): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20336)] 12:29:00.856270 run osmo-hlr_10.42.42.2(pid=20336): stdout: | (launched: 2022-12-13_12:28:57.967446) 12:29:00.906500 run osmo-hlr_10.42.42.2(pid=20336): stderr: | 20221213122858141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122858141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122858141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122858141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122858141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122858141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122858153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122858161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122858161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122858161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:00.990738 run osmo-msc_10.42.42.6(pid=20342): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20342)] 12:29:01.039557 run osmo-msc_10.42.42.6(pid=20342): stdout: | (launched: 2022-12-13_12:28:59.886690) 12:29:01.089597 run osmo-msc_10.42.42.6(pid=20342): stderr: | 20221213122900157 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122900157 DLGLOBAL DEBUG validating counter group 0x7f9c21345c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122900157 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122900157 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122900158 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122900158 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122900160 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122900160 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122900160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122900160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:01.140267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20335): Terminating (SIGTERM) 12:29:01.181531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20338): Terminating (SIGTERM) 12:29:01.223909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20341): Terminating (SIGTERM) 12:29:01.264912 --- ParallelTerminationStrategy: PID 20335 died... 12:29:01.284572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20335): Terminated: ok {rc=0} 12:29:01.329810 --- ParallelTerminationStrategy: PID 20338 died... 12:29:01.348901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20338): Terminated: ok {rc=0} 12:29:01.394640 --- ParallelTerminationStrategy: PID 20341 died... 12:29:01.413907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20341): Terminated: ok {rc=0} 12:29:01.503977 bus /sierra_3: Setting Powered False 12:29:02.608612 bus /sierra_3: Setting Powered False 12:29:03.723716 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:29:04.869978 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:29:04.881777 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:29:04.949976 tst mo_mt_call_osmux.py: using LAC 33949 12:29:05.070122 tst mo_mt_call_osmux.py: using RAC 34 12:29:05.192315 tst mo_mt_call_osmux.py: using CellId 33949 12:29:05.313271 tst mo_mt_call_osmux.py: using BVCI 33950 12:29:05.423920 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:29:05.435198 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:29:05.446205 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:29:05.457228 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:29:05.468250 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:29:05.479222 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:29:05.595640 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:29:05.718123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:06.190376 run create_hlr_db(pid=20345): Launched 12:29:06.314718 bus /sierra_2: Setting Powered False 12:29:07.375830 run create_hlr_db(pid=20345): Terminated: ok {rc=0} 12:29:07.802291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20347): Launched 12:29:08.109124 run osmo-hlr_10.42.42.2(pid=20348): Launched 12:29:08.224089 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:08.746474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20350): Launched 12:29:09.051652 run osmo-stp_10.42.42.5(pid=20351): Launched 12:29:09.167603 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:09.716307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20353): Launched 12:29:10.021377 run osmo-msc_10.42.42.6(pid=20354): Launched 12:29:10.191500 run osmo-stp_10.42.42.5(pid=20351): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20351)] 12:29:10.319263 run osmo-stp_10.42.42.5(pid=20351): stdout: | (launched: 2022-12-13_12:29:08.995785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:10.447129 run osmo-stp_10.42.42.5(pid=20351): stderr: | 20221213122909162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122909162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122909162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122909163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122909163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122909163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122909163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:10.573563 run osmo-stp_10.42.42.5(pid=20351): stdout: | (launched: 2022-12-13_12:29:08.995785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:10.695544 run osmo-stp_10.42.42.5(pid=20351): stderr: | 20221213122909162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122909162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122909162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122909163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122909163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122909163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122909163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:10.840002 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20351): Process ended prematurely: osmo-stp_10.42.42.5(pid=20351) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20351)] [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:29:10.849046 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:29:10.875571 run osmo-hlr_10.42.42.2(pid=20348): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20348)] 12:29:10.922683 run osmo-hlr_10.42.42.2(pid=20348): stdout: | (launched: 2022-12-13_12:29:08.052089) 12:29:10.971561 run osmo-hlr_10.42.42.2(pid=20348): stderr: | 20221213122908227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122908228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122908228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122908228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122908228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122908228 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122908240 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122908251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122908251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122908251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:11.040141 run osmo-msc_10.42.42.6(pid=20354): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20354)] 12:29:11.087169 run osmo-msc_10.42.42.6(pid=20354): stdout: | (launched: 2022-12-13_12:29:09.965377) 12:29:11.136452 run osmo-msc_10.42.42.6(pid=20354): stderr: | 20221213122910232 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122910232 DLGLOBAL DEBUG validating counter group 0x7f34f6d54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122910232 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122910232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122910233 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122910233 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122910235 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122910235 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122910235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122910235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:11.185576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20347): Terminating (SIGTERM) 12:29:11.224678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20350): Terminating (SIGTERM) 12:29:11.263883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20353): Terminating (SIGTERM) 12:29:11.303643 --- ParallelTerminationStrategy: PID 20347 died... 12:29:11.322719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20347): Terminated: ok {rc=0} 12:29:11.366502 --- ParallelTerminationStrategy: PID 20350 died... 12:29:11.384905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20350): Terminated: ok {rc=0} 12:29:11.429180 --- ParallelTerminationStrategy: PID 20353 died... 12:29:11.447735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20353): Terminated: ok {rc=0} 12:29:11.532699 bus /sierra_3: Setting Powered False 12:29:12.630891 bus /sierra_3: Setting Powered False 12:29:13.745142 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 12:29:14.987806 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:29:14.991947 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:29:15.021186 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:29:15.049307 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 12:29:15.138279 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:29:15.169142 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:29:15.195894 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 12:29:15.776469 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2389 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 12:29:15.781480 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:15.792171 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:29:15.845293 tst emergency_mo_mt_call.py: using LAC 33950 12:29:15.980793 tst emergency_mo_mt_call.py: using RAC 35 12:29:16.102676 tst emergency_mo_mt_call.py: using CellId 33950 12:29:16.251662 tst emergency_mo_mt_call.py: using BVCI 33951 12:29:16.364939 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:16.376360 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:16.388111 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:16.399891 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:16.411641 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:16.423333 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:29:16.536772 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:29:16.661420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:17.189436 run create_hlr_db(pid=20360): Launched 12:29:17.335082 bus /sierra_2: Setting Powered False 12:29:18.399045 run create_hlr_db(pid=20360): Terminated: ok {rc=0} 12:29:18.847945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20362): Launched 12:29:19.169380 run osmo-hlr_10.42.42.2(pid=20363): Launched 12:29:19.291904 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:19.845060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20365): Launched 12:29:20.164735 run osmo-stp_10.42.42.5(pid=20366): Launched 12:29:20.297889 tst emergency_mo_mt_call.py: using MSISDN 8152 12:29:20.461666 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:21.040654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20369): Launched 12:29:21.363118 run osmo-msc_10.42.42.6(pid=20370): Launched 12:29:21.542157 run osmo-stp_10.42.42.5(pid=20366): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20366)] 12:29:21.676501 run osmo-stp_10.42.42.5(pid=20366): stdout: | (launched: 2022-12-13_12:29:20.105743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:21.811919 run osmo-stp_10.42.42.5(pid=20366): stderr: | 20221213122920294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122920295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122920295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122920295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122920296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122920296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122920296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:21.945618 run osmo-stp_10.42.42.5(pid=20366): stdout: | (launched: 2022-12-13_12:29:20.105743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:22.072735 run osmo-stp_10.42.42.5(pid=20366): stderr: | 20221213122920294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122920295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122920295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122920295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122920296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122920296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122920296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:22.225679 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20366): Process ended prematurely: osmo-stp_10.42.42.5(pid=20366) [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20366)] [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 12:29:22.234596 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 12:29:22.262151 run osmo-hlr_10.42.42.2(pid=20363): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20363)] 12:29:22.312766 run osmo-hlr_10.42.42.2(pid=20363): stdout: | (launched: 2022-12-13_12:29:19.110762) 12:29:22.364940 run osmo-hlr_10.42.42.2(pid=20363): stderr: | 20221213122919302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122919302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122919302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122919302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122919302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122919302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122919314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122919323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122919323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122919323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:22.437320 run osmo-msc_10.42.42.6(pid=20370): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20370)] 12:29:22.487061 run osmo-msc_10.42.42.6(pid=20370): stdout: | (launched: 2022-12-13_12:29:21.304140) 12:29:22.538927 run osmo-msc_10.42.42.6(pid=20370): stderr: | 20221213122921620 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122921620 DLGLOBAL DEBUG validating counter group 0x7fa10a408c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122921621 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122921621 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122921621 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122921621 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122921623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122921623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122921623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122921623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:22.591017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20362): Terminating (SIGTERM) 12:29:22.632688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20365): Terminating (SIGTERM) 12:29:22.674551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20369): Terminating (SIGTERM) 12:29:22.716518 --- ParallelTerminationStrategy: PID 20362 died... 12:29:22.736637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20362): Terminated: ok {rc=0} 12:29:22.783312 --- ParallelTerminationStrategy: PID 20365 died... 12:29:22.803197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20365): Terminated: ok {rc=0} 12:29:22.849257 --- ParallelTerminationStrategy: PID 20369 died... 12:29:22.868835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20369): Terminated: ok {rc=0} 12:29:22.956204 bus /sierra_3: Setting Powered False 12:29:24.054235 bus /sierra_3: Setting Powered False 12:29:25.165676 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 12:29:26.250585 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:26.262636 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:29:26.311540 tst emergency_preemptive_call.py: using LAC 33951 12:29:26.429677 tst emergency_preemptive_call.py: using RAC 36 12:29:26.548813 tst emergency_preemptive_call.py: using CellId 33951 12:29:26.665285 tst emergency_preemptive_call.py: using BVCI 33952 12:29:26.772783 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:26.783715 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:26.794714 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:26.805367 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:26.816197 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:29:26.826914 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:29:26.943161 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:29:27.063003 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:29:27.179160 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:29:27.297187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:27.795011 run create_hlr_db(pid=20372): Launched 12:29:27.918474 bus /sierra_2: Setting Powered False 12:29:28.982698 run create_hlr_db(pid=20372): Terminated: ok {rc=0} 12:29:29.430965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20374): Launched 12:29:29.751615 run osmo-hlr_10.42.42.2(pid=20375): Launched 12:29:29.873600 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:30.426533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20377): Launched 12:29:30.747729 run osmo-stp_10.42.42.5(pid=20378): Launched 12:29:30.930473 tst emergency_preemptive_call.py: using MSISDN 8153 12:29:31.200393 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:31.755143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20380): Launched 12:29:32.107923 run osmo-msc_10.42.42.6(pid=20381): Launched 12:29:32.412594 run osmo-stp_10.42.42.5(pid=20378): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20378)] 12:29:32.539626 run osmo-stp_10.42.42.5(pid=20378): stdout: | (launched: 2022-12-13_12:29:30.688800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:32.668356 run osmo-stp_10.42.42.5(pid=20378): stderr: | 20221213122930934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122930935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122930935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122930935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122930936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122930936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122930936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:32.792937 run osmo-stp_10.42.42.5(pid=20378): stdout: | (launched: 2022-12-13_12:29:30.688800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:32.912625 run osmo-stp_10.42.42.5(pid=20378): stderr: | 20221213122930934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122930935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122930935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122930935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122930936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122930936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122930936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:33.054765 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20378): Process ended prematurely: osmo-stp_10.42.42.5(pid=20378) [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20378)] [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 12:29:33.063156 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 12:29:33.089793 run osmo-hlr_10.42.42.2(pid=20375): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20375)] 12:29:33.137679 run osmo-hlr_10.42.42.2(pid=20375): stdout: | (launched: 2022-12-13_12:29:29.692690) 12:29:33.186949 run osmo-hlr_10.42.42.2(pid=20375): stderr: | 20221213122929886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122929886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122929886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122929886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122929886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122929886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122929899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122929908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122929909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122929909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:33.256321 run osmo-msc_10.42.42.6(pid=20381): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20381)] 12:29:33.303865 run osmo-msc_10.42.42.6(pid=20381): stdout: | (launched: 2022-12-13_12:29:32.048701) 12:29:33.353290 run osmo-msc_10.42.42.6(pid=20381): stderr: | 20221213122932451 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213122932451 DLGLOBAL DEBUG validating counter group 0x7fe7374a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213122932451 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213122932451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213122932452 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213122932452 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213122932454 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213122932454 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213122932454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213122932454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:33.402730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20374): Terminating (SIGTERM) 12:29:33.441969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20377): Terminating (SIGTERM) 12:29:33.481414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20380): Terminating (SIGTERM) 12:29:33.521205 --- ParallelTerminationStrategy: PID 20374 died... 12:29:33.540459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20374): Terminated: ok {rc=0} 12:29:33.585139 --- ParallelTerminationStrategy: PID 20377 died... 12:29:33.603825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20377): Terminated: ok {rc=0} 12:29:33.647682 --- ParallelTerminationStrategy: PID 20380 died... 12:29:33.666326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20380): Terminated: ok {rc=0} 12:29:33.751717 bus /sierra_9: Setting Powered False 12:29:34.849887 bus /sierra_9: Setting Powered False 12:29:35.965170 bus /sierra_8: Setting Powered False 12:29:37.063585 bus /sierra_8: Setting Powered False 12:29:38.178591 bus /sierra_3: Setting Powered False 12:29:39.279118 bus /sierra_3: Setting Powered False 12:29:40.395192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 12:29:41.671514 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:29:41.676210 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:29:41.705977 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 12:29:41.746174 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 12:29:41.835795 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:29:41.865868 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 12:29:41.905768 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 12:29:42.500467 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 12:29:42.554565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:42.566111 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:29:42.611208 tst cs_paging_gprs_active.py: using LAC 33952 12:29:42.730981 tst cs_paging_gprs_active.py: using RAC 37 12:29:42.858647 tst cs_paging_gprs_active.py: using CellId 33952 12:29:42.985255 tst cs_paging_gprs_active.py: using BVCI 33953 12:29:43.103702 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:43.115203 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:43.126602 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:43.137898 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:43.149604 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:43.160808 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:43.172378 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:43.183704 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:43.195361 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:29:43.312439 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:29:43.433229 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:29:43.654065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:43.981114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20386): Launched 12:29:44.266766 run iperf3-srv_10.42.42.10(pid=20387): Launched 12:29:44.389770 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:29:44.610440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:44.938514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20388): Launched 12:29:45.223854 run iperf3-srv_10.42.42.10(pid=20389): Launched 12:29:45.346784 tst cs_paging_gprs_active.py:38: start network... 12:29:45.567008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:46.075957 run create_hlr_db(pid=20390): Launched 12:29:46.224683 bus /sierra_2: Setting Powered False 12:29:47.289885 run create_hlr_db(pid=20390): Terminated: ok {rc=0} 12:29:47.725953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20392): Launched 12:29:48.029989 run osmo-hlr_10.42.42.2(pid=20393): Launched 12:29:48.146682 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:48.682219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20395): Launched 12:29:48.989499 run osmo-stp_10.42.42.5(pid=20396): Launched 12:29:49.105438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:29:49.629861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20399): Launched 12:29:49.747261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:29:50.005612 run patchelf(pid=20400): Launched 12:29:50.176826 run osmo-stp_10.42.42.5(pid=20396): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20396)] 12:29:50.306372 run osmo-stp_10.42.42.5(pid=20396): stdout: | (launched: 2022-12-13_12:29:48.932794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:50.437619 run osmo-stp_10.42.42.5(pid=20396): stderr: | 20221213122949100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122949100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122949100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122949101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122949101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122949101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122949101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:50.569353 run osmo-stp_10.42.42.5(pid=20396): stdout: | (launched: 2022-12-13_12:29:48.932794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:50.694647 run osmo-stp_10.42.42.5(pid=20396): stderr: | 20221213122949100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213122949100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213122949100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213122949101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213122949101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213122949101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213122949101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:50.842766 run patchelf(pid=20400): Terminating (SIGINT) 12:29:51.015066 run patchelf(pid=20400): Terminated: ok {rc=0} 12:29:51.138471 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20396): Process ended prematurely: osmo-stp_10.42.42.5(pid=20396) [trial-2389↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20396)] [trial-2389↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 12:29:51.148034 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:29:51.175364 run osmo-hlr_10.42.42.2(pid=20393): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20393)] 12:29:51.222334 run osmo-hlr_10.42.42.2(pid=20393): stdout: | (launched: 2022-12-13_12:29:47.974031) 12:29:51.271050 run osmo-hlr_10.42.42.2(pid=20393): stderr: | 20221213122948145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122948145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122948146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122948146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122948146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122948146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122948158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122948167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122948167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122948167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:51.320152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20386): Terminating (SIGTERM) 12:29:51.359477 run iperf3-srv_10.42.42.10(pid=20387): Terminating (SIGTERM) 12:29:51.398604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20388): Terminating (SIGTERM) 12:29:51.437982 run iperf3-srv_10.42.42.10(pid=20389): Terminating (SIGTERM) 12:29:51.477067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20392): Terminating (SIGTERM) 12:29:51.516207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20395): Terminating (SIGTERM) 12:29:51.555591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20399): Terminating (SIGTERM) 12:29:51.595255 --- ParallelTerminationStrategy: PID 20386 died... 12:29:51.614424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20386): Terminated: ok {rc=0} 12:29:51.657754 --- ParallelTerminationStrategy: PID 20387 died... 12:29:51.676324 run iperf3-srv_10.42.42.10(pid=20387): Terminated {rc=256} 12:29:51.719587 --- ParallelTerminationStrategy: PID 20388 died... 12:29:51.738131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20388): Terminated: ok {rc=0} 12:29:51.781391 --- ParallelTerminationStrategy: PID 20389 died... 12:29:51.799864 run iperf3-srv_10.42.42.10(pid=20389): Terminated {rc=256} 12:29:51.843276 --- ParallelTerminationStrategy: PID 20392 died... 12:29:51.861855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20392): Terminated: ok {rc=0} 12:29:51.905127 --- ParallelTerminationStrategy: PID 20395 died... 12:29:51.923644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20395): Terminated: ok {rc=0} 12:29:51.967256 --- ParallelTerminationStrategy: PID 20399 died... 12:29:51.985814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20399): Terminated: ok {rc=0} 12:29:52.070858 bus /gobi_0: Setting Powered False 12:29:53.169690 bus /gobi_0: Setting Powered False 12:29:54.281771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 12:29:55.431128 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:55.443316 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:29:55.492301 tst iperf3.py: using LAC 33953 12:29:55.620724 tst iperf3.py: using RAC 38 12:29:55.751960 tst iperf3.py: using CellId 33953 12:29:55.883104 tst iperf3.py: using BVCI 33954 12:29:56.004131 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:56.015469 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:56.026606 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:56.037651 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:56.049394 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:56.061155 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:56.073257 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:56.085146 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:29:56.097053 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:29:56.216516 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:29:56.421838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:56.729315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20401): Launched 12:29:56.994704 run iperf3-srv_10.42.42.10(pid=20402): Launched 12:29:57.109469 tst iperf3.py:8: start network... 12:29:57.313414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:57.783295 run create_hlr_db(pid=20403): Launched 12:29:57.911231 bus /gobi_6: Setting Powered False 12:29:58.975970 run create_hlr_db(pid=20403): Terminated: ok {rc=0} 12:29:59.409873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20405): Launched 12:29:59.715131 run osmo-hlr_10.42.42.2(pid=20406): Launched 12:29:59.830593 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:00.374287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20408): Launched 12:30:00.679539 run osmo-stp_10.42.42.5(pid=20409): Launched 12:30:00.795057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:01.394483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20411): Launched 12:30:01.526007 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:01.805711 run patchelf(pid=20416): Launched 12:30:02.074192 run osmo-stp_10.42.42.5(pid=20409): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20409)] 12:30:02.256212 run osmo-stp_10.42.42.5(pid=20409): stdout: | (launched: 2022-12-13_12:30:00.622912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:02.424486 run osmo-stp_10.42.42.5(pid=20409): stderr: | 20221213123000791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123000791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123000791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123000792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123000792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123000793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123000793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:02.584664 run osmo-stp_10.42.42.5(pid=20409): stdout: | (launched: 2022-12-13_12:30:00.622912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:02.721324 run osmo-stp_10.42.42.5(pid=20409): stderr: | 20221213123000791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123000791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123000791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123000792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123000792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123000793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123000793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:02.880568 run patchelf(pid=20416): Terminating (SIGINT) 12:30:03.064104 run patchelf(pid=20416): Terminated: ok {rc=0} 12:30:03.197405 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20409): Process ended prematurely: osmo-stp_10.42.42.5(pid=20409) [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20409)] [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 12:30:03.208146 tst iperf3.py:8: Test FAILED (7.8 sec) 12:30:03.237199 run osmo-hlr_10.42.42.2(pid=20406): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20406)] 12:30:03.290467 run osmo-hlr_10.42.42.2(pid=20406): stdout: | (launched: 2022-12-13_12:29:59.659008) 12:30:03.343538 run osmo-hlr_10.42.42.2(pid=20406): stderr: | 20221213122959833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213122959833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213122959833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213122959833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213122959833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213122959833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213122959845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213122959853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213122959854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213122959854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:03.396797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20401): Terminating (SIGTERM) 12:30:03.439128 run iperf3-srv_10.42.42.10(pid=20402): Terminating (SIGTERM) 12:30:03.482108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20405): Terminating (SIGTERM) 12:30:03.525098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20408): Terminating (SIGTERM) 12:30:03.568279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20411): Terminating (SIGTERM) 12:30:03.611612 --- ParallelTerminationStrategy: PID 20401 died... 12:30:03.632553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20401): Terminated: ok {rc=0} 12:30:03.680101 --- ParallelTerminationStrategy: PID 20402 died... 12:30:03.700785 run iperf3-srv_10.42.42.10(pid=20402): Terminated {rc=256} 12:30:03.747872 --- ParallelTerminationStrategy: PID 20405 died... 12:30:03.768582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20405): Terminated: ok {rc=0} 12:30:03.815971 --- ParallelTerminationStrategy: PID 20408 died... 12:30:03.836231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20408): Terminated: ok {rc=0} 12:30:03.883214 --- ParallelTerminationStrategy: PID 20411 died... 12:30:03.903335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20411): Terminated: ok {rc=0} 12:30:03.991668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 12:30:05.144111 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:05.156319 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:30:05.204791 tst iperf3m4.py: using LAC 33954 12:30:05.326504 tst iperf3m4.py: using RAC 39 12:30:05.448513 tst iperf3m4.py: using CellId 33954 12:30:05.570311 tst iperf3m4.py: using BVCI 33955 12:30:05.681225 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:05.692252 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:05.703176 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:05.713900 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:05.724557 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:05.735208 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:05.746116 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:05.756645 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:05.767415 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:30:05.888223 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:30:06.007393 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:30:06.126671 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:30:06.250382 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:30:06.471181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:06.799139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20423): Launched 12:30:07.086135 run iperf3-srv_10.42.42.10(pid=20424): Launched 12:30:07.210616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:30:07.431594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:07.756558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20425): Launched 12:30:08.024746 run iperf3-srv_10.42.42.10(pid=20426): Launched 12:30:08.138988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:30:08.343091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:08.648909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20427): Launched 12:30:08.914262 run iperf3-srv_10.42.42.10(pid=20428): Launched 12:30:09.028151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:30:09.234157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:09.539637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20429): Launched 12:30:09.805912 run iperf3-srv_10.42.42.10(pid=20430): Launched 12:30:09.919686 tst iperf3m4.py:8: start network... 12:30:10.124081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:10.595317 run create_hlr_db(pid=20431): Launched 12:30:10.719169 bus /gobi_6: Setting Powered False 12:30:11.779828 run create_hlr_db(pid=20431): Terminated: ok {rc=0} 12:30:12.203804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20433): Launched 12:30:12.509741 run osmo-hlr_10.42.42.2(pid=20434): Launched 12:30:12.625187 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:13.360205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20524): Launched 12:30:13.692343 run osmo-stp_10.42.42.5(pid=20556): Launched 12:30:13.871282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:14.500463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20698): Launched 12:30:14.638555 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:14.919229 run patchelf(pid=20772): Launched 12:30:15.093076 run osmo-stp_10.42.42.5(pid=20556): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20556)] 12:30:15.220637 run osmo-stp_10.42.42.5(pid=20556): stdout: | (launched: 2022-12-13_12:30:13.631613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:15.348853 run osmo-stp_10.42.42.5(pid=20556): stderr: | 20221213123013935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123013935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123013935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123013935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123013936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123013936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123013936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:15.477326 run osmo-stp_10.42.42.5(pid=20556): stdout: | (launched: 2022-12-13_12:30:13.631613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:15.599867 run osmo-stp_10.42.42.5(pid=20556): stderr: | 20221213123013935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123013935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123013935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123013935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123013936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123013936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123013936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:15.744735 run patchelf(pid=20772): Terminating (SIGINT) 12:30:15.931005 run patchelf(pid=20772): Terminated: ok {rc=0} 12:30:16.054778 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20556): Process ended prematurely: osmo-stp_10.42.42.5(pid=20556) [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20556)] [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 12:30:16.065695 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:30:16.094484 run osmo-hlr_10.42.42.2(pid=20434): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20434)] 12:30:16.142871 run osmo-hlr_10.42.42.2(pid=20434): stdout: | (launched: 2022-12-13_12:30:12.452927) 12:30:16.193239 run osmo-hlr_10.42.42.2(pid=20434): stderr: | 20221213123012629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123012629 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123012629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123012629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123012629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123012629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123012642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123012651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123012651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123012652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:16.243215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20423): Terminating (SIGTERM) 12:30:16.283992 run iperf3-srv_10.42.42.10(pid=20424): Terminating (SIGTERM) 12:30:16.327548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20425): Terminating (SIGTERM) 12:30:16.368226 run iperf3-srv_10.42.42.10(pid=20426): Terminating (SIGTERM) 12:30:16.409884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20427): Terminating (SIGTERM) 12:30:16.451241 run iperf3-srv_10.42.42.10(pid=20428): Terminating (SIGTERM) 12:30:16.494670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20429): Terminating (SIGTERM) 12:30:16.535595 run iperf3-srv_10.42.42.10(pid=20430): Terminating (SIGTERM) 12:30:16.575668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20433): Terminating (SIGTERM) 12:30:16.615763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20524): Terminating (SIGTERM) 12:30:16.656091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20698): Terminating (SIGTERM) 12:30:16.696743 --- ParallelTerminationStrategy: PID 20423 died... 12:30:16.716332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20423): Terminated: ok {rc=0} 12:30:16.761361 --- ParallelTerminationStrategy: PID 20424 died... 12:30:16.782874 run iperf3-srv_10.42.42.10(pid=20424): Terminated {rc=256} 12:30:16.846125 --- ParallelTerminationStrategy: PID 20425 died... 12:30:16.871546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20425): Terminated: ok {rc=0} 12:30:16.917567 --- ParallelTerminationStrategy: PID 20426 died... 12:30:16.937313 run iperf3-srv_10.42.42.10(pid=20426): Terminated {rc=256} 12:30:16.982857 --- ParallelTerminationStrategy: PID 20427 died... 12:30:17.002710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20427): Terminated: ok {rc=0} 12:30:17.048283 --- ParallelTerminationStrategy: PID 20428 died... 12:30:17.068107 run iperf3-srv_10.42.42.10(pid=20428): Terminated {rc=256} 12:30:17.113803 --- ParallelTerminationStrategy: PID 20429 died... 12:30:17.133324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20429): Terminated: ok {rc=0} 12:30:17.178948 --- ParallelTerminationStrategy: PID 20430 died... 12:30:17.199069 run iperf3-srv_10.42.42.10(pid=20430): Terminated {rc=256} 12:30:17.248858 --- ParallelTerminationStrategy: PID 20433 died... 12:30:17.269460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20433): Terminated: ok {rc=0} 12:30:17.316166 --- ParallelTerminationStrategy: PID 20524 died... 12:30:17.336019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20524): Terminated: ok {rc=0} 12:30:17.383394 --- ParallelTerminationStrategy: PID 20698 died... 12:30:17.403371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20698): Terminated: ok {rc=0} 12:30:17.491196 bus /gobi_4: Setting Powered False 12:30:18.588386 bus /gobi_4: Setting Powered False 12:30:19.703455 bus /gobi_1: Setting Powered False 12:30:20.801162 bus /gobi_1: Setting Powered False 12:30:21.916244 bus /gobi_0: Setting Powered False 12:30:23.013652 bus /gobi_0: Setting Powered False 12:30:24.135603 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 12:30:25.243350 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:25.255255 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:30:25.303840 tst ping.py: using LAC 33955 12:30:25.431094 tst ping.py: using RAC 40 12:30:25.558415 tst ping.py: using CellId 33955 12:30:25.684587 tst ping.py: using BVCI 33956 12:30:25.802552 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:25.814721 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:25.826981 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:25.839247 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:25.852202 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:25.865360 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:25.878617 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:25.891574 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:30:26.018472 tst ping.py:19: start network... 12:30:26.236542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:26.733494 run create_hlr_db(pid=20967): Launched 12:30:26.868247 bus /gobi_6: Setting Powered False 12:30:27.930806 run create_hlr_db(pid=20967): Terminated: ok {rc=0} 12:30:28.382134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20969): Launched 12:30:28.720578 run osmo-hlr_10.42.42.2(pid=20970): Launched 12:30:28.970840 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:29.645692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20973): Launched 12:30:29.961371 run osmo-stp_10.42.42.5(pid=20974): Launched 12:30:30.082264 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:30.629169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20976): Launched 12:30:30.750348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:31.045767 run patchelf(pid=20977): Launched 12:30:31.277070 run osmo-stp_10.42.42.5(pid=20974): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20974)] 12:30:31.408146 run osmo-stp_10.42.42.5(pid=20974): stdout: | (launched: 2022-12-13_12:30:29.903192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:31.538006 run osmo-stp_10.42.42.5(pid=20974): stderr: | 20221213123030091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123030092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123030092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123030092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123030093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123030093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123030093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:31.669418 run osmo-stp_10.42.42.5(pid=20974): stdout: | (launched: 2022-12-13_12:30:29.903192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:31.802772 run osmo-stp_10.42.42.5(pid=20974): stderr: | 20221213123030091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123030092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123030092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123030092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123030093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123030093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123030093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:31.995350 run patchelf(pid=20977): Terminating (SIGINT) 12:30:32.166243 run patchelf(pid=20977): Terminated: ok {rc=0} 12:30:32.288051 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20974): Process ended prematurely: osmo-stp_10.42.42.5(pid=20974) [trial-2389↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20974)] [trial-2389↪gprs:trx-lms-limenet-micro↪ping.py:22] 12:30:32.297347 tst ping.py:22: Test FAILED (7.0 sec) 12:30:32.324127 run osmo-hlr_10.42.42.2(pid=20970): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20970)] 12:30:32.371832 run osmo-hlr_10.42.42.2(pid=20970): stdout: | (launched: 2022-12-13_12:30:28.660253) 12:30:32.421357 run osmo-hlr_10.42.42.2(pid=20970): stderr: | 20221213123028968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123028968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123028968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123028968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123028968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123028968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123028988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123028999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123028999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123029000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:32.471046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20969): Terminating (SIGTERM) 12:30:32.510812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20973): Terminating (SIGTERM) 12:30:32.550785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20976): Terminating (SIGTERM) 12:30:32.590426 --- ParallelTerminationStrategy: PID 20969 died... 12:30:32.609125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20969): Terminated: ok {rc=0} 12:30:32.653162 --- ParallelTerminationStrategy: PID 20973 died... 12:30:32.671730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20973): Terminated: ok {rc=0} 12:30:32.715853 --- ParallelTerminationStrategy: PID 20976 died... 12:30:32.734347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20976): Terminated: ok {rc=0} 12:30:32.819733 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 12:30:33.907219 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:33.918680 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:30:33.964060 tst ping_idle_ping.py: using LAC 33956 12:30:34.090086 tst ping_idle_ping.py: using RAC 41 12:30:34.214220 tst ping_idle_ping.py: using CellId 33956 12:30:34.339786 tst ping_idle_ping.py: using BVCI 33957 12:30:34.454677 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:34.465879 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:34.476910 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:34.488344 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:34.499616 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:34.511029 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:34.522453 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:30:34.533775 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:30:34.648650 tst ping_idle_ping.py:24: start network... 12:30:34.848801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:35.308822 run create_hlr_db(pid=20978): Launched 12:30:35.431328 bus /gobi_6: Setting Powered False 12:30:36.490761 run create_hlr_db(pid=20978): Terminated: ok {rc=0} 12:30:36.904590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20980): Launched 12:30:37.201603 run osmo-hlr_10.42.42.2(pid=20981): Launched 12:30:37.314741 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:37.827282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20983): Launched 12:30:38.123928 run osmo-stp_10.42.42.5(pid=20984): Launched 12:30:38.236678 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:38.749713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20986): Launched 12:30:38.863609 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:39.114769 run patchelf(pid=20987): Launched 12:30:39.279544 run osmo-stp_10.42.42.5(pid=20984): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20984)] 12:30:39.406471 run osmo-stp_10.42.42.5(pid=20984): stdout: | (launched: 2022-12-13_12:30:38.068716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:39.534431 run osmo-stp_10.42.42.5(pid=20984): stderr: | 20221213123038237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123038237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123038238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123038238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123038239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123038239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123038239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:39.661948 run osmo-stp_10.42.42.5(pid=20984): stdout: | (launched: 2022-12-13_12:30:38.068716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:39.783517 run osmo-stp_10.42.42.5(pid=20984): stderr: | 20221213123038237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123038237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123038238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123038238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123038239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123038239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123038239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:39.927616 run patchelf(pid=20987): Terminating (SIGINT) 12:30:40.092913 run patchelf(pid=20987): Terminated: ok {rc=0} 12:30:40.212850 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20984): Process ended prematurely: osmo-stp_10.42.42.5(pid=20984) [trial-2389↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20984)] [trial-2389↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 12:30:40.221945 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 12:30:40.248402 run osmo-hlr_10.42.42.2(pid=20981): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20981)] 12:30:40.295465 run osmo-hlr_10.42.42.2(pid=20981): stdout: | (launched: 2022-12-13_12:30:37.146288) 12:30:40.344276 run osmo-hlr_10.42.42.2(pid=20981): stderr: | 20221213123037318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123037318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123037318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123037318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123037318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123037318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123037330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123037341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123037341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123037341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:40.393571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20980): Terminating (SIGTERM) 12:30:40.432583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20983): Terminating (SIGTERM) 12:30:40.471740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20986): Terminating (SIGTERM) 12:30:40.511262 --- ParallelTerminationStrategy: PID 20980 died... 12:30:40.530230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20980): Terminated: ok {rc=0} 12:30:40.573648 --- ParallelTerminationStrategy: PID 20983 died... 12:30:40.592139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20983): Terminated: ok {rc=0} 12:30:40.635318 --- ParallelTerminationStrategy: PID 20986 died... 12:30:40.653735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20986): Terminated: ok {rc=0} 12:30:40.736038 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 12:30:42.037013 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:30:42.042871 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:30:42.072462 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:30:42.112531 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:30:42.201849 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:30:42.231741 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:30:42.271155 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:30:42.869770 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:30:42.922133 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:42.933548 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:30:42.981543 tst cs_paging_gprs_active.py: using LAC 33957 12:30:43.100803 tst cs_paging_gprs_active.py: using RAC 42 12:30:43.223440 tst cs_paging_gprs_active.py: using CellId 33957 12:30:43.355287 tst cs_paging_gprs_active.py: using BVCI 33958 12:30:43.466863 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:43.478104 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:43.489038 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:43.499910 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:43.510781 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:43.521705 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:43.532654 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:43.543480 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:43.554500 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:43.671938 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:43.790495 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:30:43.992299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:44.294849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20993): Launched 12:30:44.557797 run iperf3-srv_10.42.42.10(pid=20994): Launched 12:30:44.671349 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:30:44.874187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:45.178289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20995): Launched 12:30:45.441969 run iperf3-srv_10.42.42.10(pid=20996): Launched 12:30:45.555203 tst cs_paging_gprs_active.py:38: start network... 12:30:45.756592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:46.265924 run create_hlr_db(pid=20997): Launched 12:30:46.434749 bus /gobi_6: Setting Powered False 12:30:47.494800 run create_hlr_db(pid=20997): Terminated: ok {rc=0} 12:30:47.957687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20999): Launched 12:30:48.282477 run osmo-hlr_10.42.42.2(pid=21000): Launched 12:30:48.406003 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:48.962121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21002): Launched 12:30:49.286609 run osmo-stp_10.42.42.5(pid=21003): Launched 12:30:49.410458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:49.967346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21005): Launched 12:30:50.091554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:50.366786 run patchelf(pid=21006): Launched 12:30:50.547241 run osmo-stp_10.42.42.5(pid=21003): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21003)] 12:30:50.684532 run osmo-stp_10.42.42.5(pid=21003): stdout: | (launched: 2022-12-13_12:30:49.227426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:50.823622 run osmo-stp_10.42.42.5(pid=21003): stderr: | 20221213123049414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123049414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123049414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123049415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123049415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123049415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123049415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:50.962933 run osmo-stp_10.42.42.5(pid=21003): stdout: | (launched: 2022-12-13_12:30:49.227426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:51.095633 run osmo-stp_10.42.42.5(pid=21003): stderr: | 20221213123049414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123049414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123049414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123049415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123049415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123049415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123049415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:51.253428 run patchelf(pid=21006): Terminating (SIGINT) 12:30:51.435253 run patchelf(pid=21006): Terminated: ok {rc=0} 12:30:51.566428 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21003): Process ended prematurely: osmo-stp_10.42.42.5(pid=21003) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21003)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:30:51.576616 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:30:51.605174 run osmo-hlr_10.42.42.2(pid=21000): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21000)] 12:30:51.655388 run osmo-hlr_10.42.42.2(pid=21000): stdout: | (launched: 2022-12-13_12:30:48.222975) 12:30:51.707400 run osmo-hlr_10.42.42.2(pid=21000): stderr: | 20221213123048417 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123048417 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123048417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123048417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123048417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123048417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123048431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123048440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123048440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123048440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:51.759302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20993): Terminating (SIGTERM) 12:30:51.801205 run iperf3-srv_10.42.42.10(pid=20994): Terminating (SIGTERM) 12:30:51.843921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20995): Terminating (SIGTERM) 12:30:51.886308 run iperf3-srv_10.42.42.10(pid=20996): Terminating (SIGTERM) 12:30:51.928885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20999): Terminating (SIGTERM) 12:30:51.970853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21002): Terminating (SIGTERM) 12:30:52.012526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21005): Terminating (SIGTERM) 12:30:52.054553 --- ParallelTerminationStrategy: PID 20993 died... 12:30:52.074879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20993): Terminated: ok {rc=0} 12:30:52.120865 --- ParallelTerminationStrategy: PID 20994 died... 12:30:52.140528 run iperf3-srv_10.42.42.10(pid=20994): Terminated {rc=256} 12:30:52.186827 --- ParallelTerminationStrategy: PID 20995 died... 12:30:52.206506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20995): Terminated: ok {rc=0} 12:30:52.252530 --- ParallelTerminationStrategy: PID 20996 died... 12:30:52.272193 run iperf3-srv_10.42.42.10(pid=20996): Terminated {rc=256} 12:30:52.317956 --- ParallelTerminationStrategy: PID 20999 died... 12:30:52.337628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20999): Terminated: ok {rc=0} 12:30:52.383400 --- ParallelTerminationStrategy: PID 21002 died... 12:30:52.403136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21002): Terminated: ok {rc=0} 12:30:52.449242 --- ParallelTerminationStrategy: PID 21005 died... 12:30:52.468790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21005): Terminated: ok {rc=0} 12:30:52.556596 bus /gobi_0: Setting Powered False 12:30:53.656059 bus /gobi_0: Setting Powered False 12:30:54.773262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:30:55.918770 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:55.930543 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:30:55.977574 tst iperf3.py: using LAC 33958 12:30:56.105438 tst iperf3.py: using RAC 43 12:30:56.224703 tst iperf3.py: using CellId 33958 12:30:56.343908 tst iperf3.py: using BVCI 33959 12:30:56.455088 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:56.466267 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:56.477172 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:56.487967 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:56.498759 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:56.509598 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:56.520563 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:56.531402 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:56.542368 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:56.658725 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:30:56.860636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:57.163163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21010): Launched 12:30:57.427262 run iperf3-srv_10.42.42.10(pid=21011): Launched 12:30:57.540769 tst iperf3.py:8: start network... 12:30:57.743606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:58.210074 run create_hlr_db(pid=21012): Launched 12:30:58.334120 bus /gobi_6: Setting Powered False 12:30:59.398716 run create_hlr_db(pid=21012): Terminated: ok {rc=0} 12:30:59.849268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Launched 12:31:00.172387 run osmo-hlr_10.42.42.2(pid=21015): Launched 12:31:00.297751 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:00.867279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Launched 12:31:01.208011 run osmo-stp_10.42.42.5(pid=21018): Launched 12:31:01.455879 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:02.081794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21020): Launched 12:31:02.209968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:02.465547 run patchelf(pid=21021): Launched 12:31:02.634558 run osmo-stp_10.42.42.5(pid=21018): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] 12:31:02.763263 run osmo-stp_10.42.42.5(pid=21018): stdout: | (launched: 2022-12-13_12:31:01.146335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:02.893207 run osmo-stp_10.42.42.5(pid=21018): stderr: | 20221213123101436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123101436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123101436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123101437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123101437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123101438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123101438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:03.023102 run osmo-stp_10.42.42.5(pid=21018): stdout: | (launched: 2022-12-13_12:31:01.146335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:03.147040 run osmo-stp_10.42.42.5(pid=21018): stderr: | 20221213123101436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123101436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123101436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123101437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123101437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123101438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123101438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:03.294003 run patchelf(pid=21021): Terminating (SIGINT) 12:31:03.463799 run patchelf(pid=21021): Terminated: ok {rc=0} 12:31:03.586610 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21018): Process ended prematurely: osmo-stp_10.42.42.5(pid=21018) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 12:31:03.596122 tst iperf3.py:8: Test FAILED (7.7 sec) 12:31:03.623398 run osmo-hlr_10.42.42.2(pid=21015): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21015)] 12:31:03.670539 run osmo-hlr_10.42.42.2(pid=21015): stdout: | (launched: 2022-12-13_12:31:00.113266) 12:31:03.719255 run osmo-hlr_10.42.42.2(pid=21015): stderr: | 20221213123100310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123100310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123100310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123100310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123100310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123100310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123100323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123100331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123100331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123100331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:03.769211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21010): Terminating (SIGTERM) 12:31:03.808743 run iperf3-srv_10.42.42.10(pid=21011): Terminating (SIGTERM) 12:31:03.848252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Terminating (SIGTERM) 12:31:03.887690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Terminating (SIGTERM) 12:31:03.927072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21020): Terminating (SIGTERM) 12:31:03.966856 --- ParallelTerminationStrategy: PID 21010 died... 12:31:03.985963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21010): Terminated: ok {rc=0} 12:31:04.030018 --- ParallelTerminationStrategy: PID 21011 died... 12:31:04.048490 run iperf3-srv_10.42.42.10(pid=21011): Terminated {rc=256} 12:31:04.092002 --- ParallelTerminationStrategy: PID 21014 died... 12:31:04.110507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Terminated: ok {rc=0} 12:31:04.154018 --- ParallelTerminationStrategy: PID 21017 died... 12:31:04.172394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Terminated: ok {rc=0} 12:31:04.216097 --- ParallelTerminationStrategy: PID 21020 died... 12:31:04.234869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21020): Terminated: ok {rc=0} 12:31:04.320116 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:31:05.466659 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:05.478653 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:31:05.525815 tst iperf3m4.py: using LAC 33959 12:31:05.647847 tst iperf3m4.py: using RAC 44 12:31:05.768709 tst iperf3m4.py: using CellId 33959 12:31:05.887890 tst iperf3m4.py: using BVCI 33960 12:31:05.997238 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:06.008484 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:06.019614 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:06.030711 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:06.042043 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:06.053339 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:06.064557 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:06.075621 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:06.086970 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:31:06.215576 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:31:06.333690 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:31:06.452155 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:31:06.571633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:31:06.775382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:07.079313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21022): Launched 12:31:07.344657 run iperf3-srv_10.42.42.10(pid=21023): Launched 12:31:07.458262 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:31:07.662682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:07.967964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21024): Launched 12:31:08.232295 run iperf3-srv_10.42.42.10(pid=21025): Launched 12:31:08.345419 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:31:08.548652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:08.853688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21026): Launched 12:31:09.119477 run iperf3-srv_10.42.42.10(pid=21027): Launched 12:31:09.232688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:31:09.435714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:09.740754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21028): Launched 12:31:10.005026 run iperf3-srv_10.42.42.10(pid=21029): Launched 12:31:10.118522 tst iperf3m4.py:8: start network... 12:31:10.321933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:10.790281 run create_hlr_db(pid=21030): Launched 12:31:10.914505 bus /gobi_6: Setting Powered False 12:31:11.975232 run create_hlr_db(pid=21030): Terminated: ok {rc=0} 12:31:12.419219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21032): Launched 12:31:12.744257 run osmo-hlr_10.42.42.2(pid=21033): Launched 12:31:12.867550 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:13.433696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21035): Launched 12:31:13.759848 run osmo-stp_10.42.42.5(pid=21036): Launched 12:31:13.880688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:14.403173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21038): Launched 12:31:14.521104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:14.778675 run patchelf(pid=21039): Launched 12:31:14.947049 run osmo-stp_10.42.42.5(pid=21036): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21036)] 12:31:15.075685 run osmo-stp_10.42.42.5(pid=21036): stdout: | (launched: 2022-12-13_12:31:13.700447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:15.206260 run osmo-stp_10.42.42.5(pid=21036): stderr: | 20221213123113872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123113872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123113873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123113873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123113874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123113874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123113874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:15.336445 run osmo-stp_10.42.42.5(pid=21036): stdout: | (launched: 2022-12-13_12:31:13.700447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:15.460676 run osmo-stp_10.42.42.5(pid=21036): stderr: | 20221213123113872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123113872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123113873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123113873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123113874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123113874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123113874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:15.607555 run patchelf(pid=21039): Terminating (SIGINT) 12:31:15.777905 run patchelf(pid=21039): Terminated: ok {rc=0} 12:31:15.912592 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21036): Process ended prematurely: osmo-stp_10.42.42.5(pid=21036) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21036)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 12:31:15.923290 tst iperf3m4.py:8: Test FAILED (10.5 sec) 12:31:15.951416 run osmo-hlr_10.42.42.2(pid=21033): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21033)] 12:31:16.000008 run osmo-hlr_10.42.42.2(pid=21033): stdout: | (launched: 2022-12-13_12:31:12.684330) 12:31:16.050315 run osmo-hlr_10.42.42.2(pid=21033): stderr: | 20221213123112877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123112877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123112877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123112878 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123112878 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123112878 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123112894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123112904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123112904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123112904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:16.101165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21022): Terminating (SIGTERM) 12:31:16.141913 run iperf3-srv_10.42.42.10(pid=21023): Terminating (SIGTERM) 12:31:16.182592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21024): Terminating (SIGTERM) 12:31:16.223451 run iperf3-srv_10.42.42.10(pid=21025): Terminating (SIGTERM) 12:31:16.265593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21026): Terminating (SIGTERM) 12:31:16.307356 run iperf3-srv_10.42.42.10(pid=21027): Terminating (SIGTERM) 12:31:16.350507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21028): Terminating (SIGTERM) 12:31:16.391753 run iperf3-srv_10.42.42.10(pid=21029): Terminating (SIGTERM) 12:31:16.432157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21032): Terminating (SIGTERM) 12:31:16.473320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21035): Terminating (SIGTERM) 12:31:16.515401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21038): Terminating (SIGTERM) 12:31:16.557007 --- ParallelTerminationStrategy: PID 21022 died... 12:31:16.576431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21022): Terminated: ok {rc=0} 12:31:16.623086 --- ParallelTerminationStrategy: PID 21023 died... 12:31:16.642374 run iperf3-srv_10.42.42.10(pid=21023): Terminated {rc=256} 12:31:16.687045 --- ParallelTerminationStrategy: PID 21024 died... 12:31:16.706507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21024): Terminated: ok {rc=0} 12:31:16.751413 --- ParallelTerminationStrategy: PID 21025 died... 12:31:16.770530 run iperf3-srv_10.42.42.10(pid=21025): Terminated {rc=256} 12:31:16.815648 --- ParallelTerminationStrategy: PID 21026 died... 12:31:16.834793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21026): Terminated: ok {rc=0} 12:31:16.879396 --- ParallelTerminationStrategy: PID 21027 died... 12:31:16.903592 run iperf3-srv_10.42.42.10(pid=21027): Terminated {rc=256} 12:31:16.973476 --- ParallelTerminationStrategy: PID 21028 died... 12:31:16.999205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21028): Terminated: ok {rc=0} 12:31:17.063192 --- ParallelTerminationStrategy: PID 21029 died... 12:31:17.089646 run iperf3-srv_10.42.42.10(pid=21029): Terminated {rc=256} 12:31:17.152677 --- ParallelTerminationStrategy: PID 21032 died... 12:31:17.177950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21032): Terminated: ok {rc=0} 12:31:17.226652 --- ParallelTerminationStrategy: PID 21035 died... 12:31:17.248072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21035): Terminated: ok {rc=0} 12:31:17.296921 --- ParallelTerminationStrategy: PID 21038 died... 12:31:17.317706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21038): Terminated: ok {rc=0} 12:31:17.407517 bus /gobi_4: Setting Powered False 12:31:18.506425 bus /gobi_4: Setting Powered False 12:31:19.624229 bus /gobi_1: Setting Powered False 12:31:20.722262 bus /gobi_1: Setting Powered False 12:31:21.836706 bus /gobi_0: Setting Powered False 12:31:22.946695 bus /gobi_0: Setting Powered False 12:31:24.063640 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 12:31:25.163776 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:25.175241 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:31:25.222571 tst ping.py: using LAC 33960 12:31:25.339700 tst ping.py: using RAC 45 12:31:25.458009 tst ping.py: using CellId 33960 12:31:25.574523 tst ping.py: using BVCI 33961 12:31:25.683644 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:25.694972 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:25.706013 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:25.716854 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:25.727655 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:25.738825 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:25.749867 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:25.761057 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:31:25.879105 tst ping.py:19: start network... 12:31:26.093532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:26.584237 run create_hlr_db(pid=21040): Launched 12:31:26.705977 bus /gobi_6: Setting Powered False 12:31:27.768935 run create_hlr_db(pid=21040): Terminated: ok {rc=0} 12:31:28.212017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21042): Launched 12:31:28.531817 run osmo-hlr_10.42.42.2(pid=21043): Launched 12:31:28.653377 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:29.200722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21045): Launched 12:31:29.517492 run osmo-stp_10.42.42.5(pid=21046): Launched 12:31:29.639981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:30.190958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21048): Launched 12:31:30.315046 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:30.583991 run patchelf(pid=21049): Launched 12:31:30.761178 run osmo-stp_10.42.42.5(pid=21046): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21046)] 12:31:30.903596 run osmo-stp_10.42.42.5(pid=21046): stdout: | (launched: 2022-12-13_12:31:29.458907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:31.043950 run osmo-stp_10.42.42.5(pid=21046): stderr: | 20221213123129648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123129648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123129648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123129649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123129649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123129649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123129649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:31.184111 run osmo-stp_10.42.42.5(pid=21046): stdout: | (launched: 2022-12-13_12:31:29.458907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:31.318579 run osmo-stp_10.42.42.5(pid=21046): stderr: | 20221213123129648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123129648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123129648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123129649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123129649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123129649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123129649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:31.476583 run patchelf(pid=21049): Terminating (SIGINT) 12:31:31.658348 run patchelf(pid=21049): Terminated: ok {rc=0} 12:31:31.790476 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21046): Process ended prematurely: osmo-stp_10.42.42.5(pid=21046) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21046)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 12:31:31.801291 tst ping.py:22: Test FAILED (6.6 sec) 12:31:31.830656 run osmo-hlr_10.42.42.2(pid=21043): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21043)] 12:31:31.885369 run osmo-hlr_10.42.42.2(pid=21043): stdout: | (launched: 2022-12-13_12:31:28.473673) 12:31:31.939686 run osmo-hlr_10.42.42.2(pid=21043): stderr: | 20221213123128669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123128669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123128669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123128669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123128669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123128669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123128681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123128689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123128689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123128689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:31.994914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21042): Terminating (SIGTERM) 12:31:32.038136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21045): Terminating (SIGTERM) 12:31:32.082210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21048): Terminating (SIGTERM) 12:31:32.126499 --- ParallelTerminationStrategy: PID 21042 died... 12:31:32.148309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21042): Terminated: ok {rc=0} 12:31:32.197517 --- ParallelTerminationStrategy: PID 21045 died... 12:31:32.217985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21045): Terminated: ok {rc=0} 12:31:32.264478 --- ParallelTerminationStrategy: PID 21048 died... 12:31:32.284502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21048): Terminated: ok {rc=0} 12:31:32.374137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:31:33.461389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:33.473699 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:31:33.522955 tst ping_idle_ping.py: using LAC 33961 12:31:33.649370 tst ping_idle_ping.py: using RAC 46 12:31:33.773197 tst ping_idle_ping.py: using CellId 33961 12:31:33.898970 tst ping_idle_ping.py: using BVCI 33962 12:31:34.014265 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:34.025939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:34.037299 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:34.048541 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:34.060126 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:34.071580 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:34.083415 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:34.095062 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:31:34.210081 tst ping_idle_ping.py:24: start network... 12:31:34.409483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:34.871773 run create_hlr_db(pid=21050): Launched 12:31:34.993459 bus /gobi_6: Setting Powered False 12:31:36.053781 run create_hlr_db(pid=21050): Terminated: ok {rc=0} 12:31:36.491806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21052): Launched 12:31:36.811547 run osmo-hlr_10.42.42.2(pid=21053): Launched 12:31:36.935605 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:37.487950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21055): Launched 12:31:37.806692 run osmo-stp_10.42.42.5(pid=21056): Launched 12:31:37.930306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:38.480916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21058): Launched 12:31:38.602837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:38.871620 run patchelf(pid=21059): Launched 12:31:39.050147 run osmo-stp_10.42.42.5(pid=21056): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21056)] 12:31:39.185403 run osmo-stp_10.42.42.5(pid=21056): stdout: | (launched: 2022-12-13_12:31:37.748007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:39.322856 run osmo-stp_10.42.42.5(pid=21056): stderr: | 20221213123137938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123137938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123137938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123137939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123137939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123137939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123137940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:39.459863 run osmo-stp_10.42.42.5(pid=21056): stdout: | (launched: 2022-12-13_12:31:37.748007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:39.590781 run osmo-stp_10.42.42.5(pid=21056): stderr: | 20221213123137938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123137938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123137938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123137939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123137939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123137939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123137940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:39.745862 run patchelf(pid=21059): Terminating (SIGINT) 12:31:39.924008 run patchelf(pid=21059): Terminated: ok {rc=0} 12:31:40.053208 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21056): Process ended prematurely: osmo-stp_10.42.42.5(pid=21056) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21056)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 12:31:40.063038 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:31:40.091147 run osmo-hlr_10.42.42.2(pid=21053): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21053)] 12:31:40.141777 run osmo-hlr_10.42.42.2(pid=21053): stdout: | (launched: 2022-12-13_12:31:36.752883) 12:31:40.194470 run osmo-hlr_10.42.42.2(pid=21053): stderr: | 20221213123136949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123136949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123136949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123136949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123136949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123136950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123136963 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123136971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123136971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123136971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:40.247178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21052): Terminating (SIGTERM) 12:31:40.289487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21055): Terminating (SIGTERM) 12:31:40.332010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21058): Terminating (SIGTERM) 12:31:40.374556 --- ParallelTerminationStrategy: PID 21052 died... 12:31:40.394869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21052): Terminated: ok {rc=0} 12:31:40.441453 --- ParallelTerminationStrategy: PID 21055 died... 12:31:40.461325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21055): Terminated: ok {rc=0} 12:31:40.507692 --- ParallelTerminationStrategy: PID 21058 died... 12:31:40.527686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21058): Terminated: ok {rc=0} 12:31:40.616351 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:31:41.924520 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:31:41.930941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:31:41.960632 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:31:42.000710 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:31:42.090273 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:31:42.120025 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:31:42.159896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:31:42.760218 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:31:42.812395 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:42.823976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:31:42.895491 tst cs_paging_gprs_active.py: using LAC 33962 12:31:43.020567 tst cs_paging_gprs_active.py: using RAC 47 12:31:43.146204 tst cs_paging_gprs_active.py: using CellId 33962 12:31:43.272434 tst cs_paging_gprs_active.py: using BVCI 33963 12:31:43.390614 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:43.402214 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:43.413629 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:43.425084 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:43.436625 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:43.448251 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:43.460008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:43.471647 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:43.483425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:43.599295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:43.720387 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:31:43.940474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:44.268179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21063): Launched 12:31:44.551775 run iperf3-srv_10.42.42.10(pid=21064): Launched 12:31:44.674734 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:31:44.894134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:45.221723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21065): Launched 12:31:45.506963 run iperf3-srv_10.42.42.10(pid=21066): Launched 12:31:45.630798 tst cs_paging_gprs_active.py:38: start network... 12:31:45.859683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:46.373479 run create_hlr_db(pid=21067): Launched 12:31:46.533802 bus /gobi_6: Setting Powered False 12:31:47.594587 run create_hlr_db(pid=21067): Terminated: ok {rc=0} 12:31:48.053061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21069): Launched 12:31:48.379565 run osmo-hlr_10.42.42.2(pid=21070): Launched 12:31:48.504233 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:49.061468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21072): Launched 12:31:49.389678 run osmo-stp_10.42.42.5(pid=21073): Launched 12:31:49.515721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:50.078276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21075): Launched 12:31:50.205135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:50.481126 run patchelf(pid=21076): Launched 12:31:50.663803 run osmo-stp_10.42.42.5(pid=21073): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21073)] 12:31:50.801606 run osmo-stp_10.42.42.5(pid=21073): stdout: | (launched: 2022-12-13_12:31:49.329879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:50.941892 run osmo-stp_10.42.42.5(pid=21073): stderr: | 20221213123149518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123149518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123149518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123149519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123149519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123149519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123149519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:51.081938 run osmo-stp_10.42.42.5(pid=21073): stdout: | (launched: 2022-12-13_12:31:49.329879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:51.215498 run osmo-stp_10.42.42.5(pid=21073): stderr: | 20221213123149518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123149518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123149518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123149519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123149519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123149519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123149519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:51.373996 run patchelf(pid=21076): Terminating (SIGINT) 12:31:51.556680 run patchelf(pid=21076): Terminated: ok {rc=0} 12:31:51.688338 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21073): Process ended prematurely: osmo-stp_10.42.42.5(pid=21073) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21073)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:31:51.698820 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:31:51.727334 run osmo-hlr_10.42.42.2(pid=21070): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21070)] 12:31:51.777691 run osmo-hlr_10.42.42.2(pid=21070): stdout: | (launched: 2022-12-13_12:31:48.319502) 12:31:51.829679 run osmo-hlr_10.42.42.2(pid=21070): stderr: | 20221213123148514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123148514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123148514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123148514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123148515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123148515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123148526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123148535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123148535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123148535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:51.881850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21063): Terminating (SIGTERM) 12:31:51.923570 run iperf3-srv_10.42.42.10(pid=21064): Terminating (SIGTERM) 12:31:51.965829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21065): Terminating (SIGTERM) 12:31:52.007573 run iperf3-srv_10.42.42.10(pid=21066): Terminating (SIGTERM) 12:31:52.049218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21069): Terminating (SIGTERM) 12:31:52.091393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21072): Terminating (SIGTERM) 12:31:52.133014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21075): Terminating (SIGTERM) 12:31:52.175385 --- ParallelTerminationStrategy: PID 21063 died... 12:31:52.195493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21063): Terminated: ok {rc=0} 12:31:52.242059 --- ParallelTerminationStrategy: PID 21064 died... 12:31:52.261999 run iperf3-srv_10.42.42.10(pid=21064): Terminated {rc=256} 12:31:52.308029 --- ParallelTerminationStrategy: PID 21065 died... 12:31:52.327687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21065): Terminated: ok {rc=0} 12:31:52.373684 --- ParallelTerminationStrategy: PID 21066 died... 12:31:52.393349 run iperf3-srv_10.42.42.10(pid=21066): Terminated {rc=256} 12:31:52.439239 --- ParallelTerminationStrategy: PID 21069 died... 12:31:52.459051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21069): Terminated: ok {rc=0} 12:31:52.505283 --- ParallelTerminationStrategy: PID 21072 died... 12:31:52.525098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21072): Terminated: ok {rc=0} 12:31:52.571291 --- ParallelTerminationStrategy: PID 21075 died... 12:31:52.591047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21075): Terminated: ok {rc=0} 12:31:52.679345 bus /gobi_0: Setting Powered False 12:31:53.778386 bus /gobi_0: Setting Powered False 12:31:54.896888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:31:56.046469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:56.058835 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:31:56.134067 tst iperf3.py: using LAC 33963 12:31:56.261395 tst iperf3.py: using RAC 48 12:31:56.386304 tst iperf3.py: using CellId 33963 12:31:56.513344 tst iperf3.py: using BVCI 33964 12:31:56.630754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:56.642416 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:56.653985 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:56.665507 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:56.677171 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:56.688837 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:56.700744 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:56.712440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:56.724346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:56.842091 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:31:57.046660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:57.353277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21077): Launched 12:31:57.619415 run iperf3-srv_10.42.42.10(pid=21078): Launched 12:31:57.733142 tst iperf3.py:8: start network... 12:31:57.937194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:58.408282 run create_hlr_db(pid=21079): Launched 12:31:58.532252 bus /gobi_6: Setting Powered False 12:31:59.593705 run create_hlr_db(pid=21079): Terminated: ok {rc=0} 12:32:00.038154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21081): Launched 12:32:00.365328 run osmo-hlr_10.42.42.2(pid=21082): Launched 12:32:00.488728 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:01.075561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21084): Launched 12:32:01.403436 run osmo-stp_10.42.42.5(pid=21085): Launched 12:32:01.550450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:02.295007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21087): Launched 12:32:02.411627 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:02.669205 run patchelf(pid=21088): Launched 12:32:02.839162 run osmo-stp_10.42.42.5(pid=21085): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21085)] 12:32:02.967920 run osmo-stp_10.42.42.5(pid=21085): stdout: | (launched: 2022-12-13_12:32:01.342840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:03.098260 run osmo-stp_10.42.42.5(pid=21085): stderr: | 20221213123201693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123201693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123201694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123201694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123201694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123201695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123201695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:03.229219 run osmo-stp_10.42.42.5(pid=21085): stdout: | (launched: 2022-12-13_12:32:01.342840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:03.353234 run osmo-stp_10.42.42.5(pid=21085): stderr: | 20221213123201693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123201693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123201694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123201694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123201694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123201695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123201695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:03.499996 run patchelf(pid=21088): Terminating (SIGINT) 12:32:03.670038 run patchelf(pid=21088): Terminated: ok {rc=0} 12:32:03.793265 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21085): Process ended prematurely: osmo-stp_10.42.42.5(pid=21085) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21085)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 12:32:03.802931 tst iperf3.py:8: Test FAILED (7.8 sec) 12:32:03.830288 run osmo-hlr_10.42.42.2(pid=21082): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21082)] 12:32:03.877727 run osmo-hlr_10.42.42.2(pid=21082): stdout: | (launched: 2022-12-13_12:32:00.304104) 12:32:03.927104 run osmo-hlr_10.42.42.2(pid=21082): stderr: | 20221213123200501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123200501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123200501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123200501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123200501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123200501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123200522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123200531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123200531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123200531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:03.977072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21077): Terminating (SIGTERM) 12:32:04.017119 run iperf3-srv_10.42.42.10(pid=21078): Terminating (SIGTERM) 12:32:04.057592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21081): Terminating (SIGTERM) 12:32:04.098071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21084): Terminating (SIGTERM) 12:32:04.137708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21087): Terminating (SIGTERM) 12:32:04.177560 --- ParallelTerminationStrategy: PID 21077 died... 12:32:04.196486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21077): Terminated: ok {rc=0} 12:32:04.240544 --- ParallelTerminationStrategy: PID 21078 died... 12:32:04.259205 run iperf3-srv_10.42.42.10(pid=21078): Terminated {rc=256} 12:32:04.303029 --- ParallelTerminationStrategy: PID 21081 died... 12:32:04.321713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21081): Terminated: ok {rc=0} 12:32:04.365341 --- ParallelTerminationStrategy: PID 21084 died... 12:32:04.383871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21084): Terminated: ok {rc=0} 12:32:04.427639 --- ParallelTerminationStrategy: PID 21087 died... 12:32:04.446317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21087): Terminated: ok {rc=0} 12:32:04.531899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:32:05.679675 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:05.691914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:32:05.756739 tst iperf3m4.py: using LAC 33964 12:32:05.876799 tst iperf3m4.py: using RAC 49 12:32:05.994969 tst iperf3m4.py: using CellId 33964 12:32:06.119850 tst iperf3m4.py: using BVCI 33965 12:32:06.240561 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:06.252113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:06.263727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:06.275081 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:06.287256 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:06.299429 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:06.311715 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:06.323962 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:06.336293 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:32:06.458969 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:32:06.578198 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:32:06.698187 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:32:06.819885 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:32:07.039744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:32:07.366287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21089): Launched 12:32:07.650662 run iperf3-srv_10.42.42.10(pid=21090): Launched 12:32:07.774100 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:32:07.993923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:32:08.321067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21091): Launched 12:32:08.605712 run iperf3-srv_10.42.42.10(pid=21092): Launched 12:32:08.727431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:32:08.947233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:32:09.274627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21093): Launched 12:32:09.560068 run iperf3-srv_10.42.42.10(pid=21094): Launched 12:32:09.682194 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:32:09.902329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:32:10.229755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21095): Launched 12:32:10.515537 run iperf3-srv_10.42.42.10(pid=21096): Launched 12:32:10.638775 tst iperf3m4.py:8: start network... 12:32:10.858767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:11.361962 run create_hlr_db(pid=21097): Launched 12:32:11.487452 bus /gobi_6: Setting Powered False 12:32:12.552619 run create_hlr_db(pid=21097): Terminated: ok {rc=0} 12:32:13.005064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21099): Launched 12:32:13.332425 run osmo-hlr_10.42.42.2(pid=21100): Launched 12:32:13.456125 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:14.020232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21102): Launched 12:32:14.346160 run osmo-stp_10.42.42.5(pid=21103): Launched 12:32:14.471336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:15.030229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21105): Launched 12:32:15.155373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:15.430501 run patchelf(pid=21106): Launched 12:32:15.612410 run osmo-stp_10.42.42.5(pid=21103): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21103)] 12:32:15.750217 run osmo-stp_10.42.42.5(pid=21103): stdout: | (launched: 2022-12-13_12:32:14.286100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:15.904350 run osmo-stp_10.42.42.5(pid=21103): stderr: | 20221213123214473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123214473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123214474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123214474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123214474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123214474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123214475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:16.038648 run osmo-stp_10.42.42.5(pid=21103): stdout: | (launched: 2022-12-13_12:32:14.286100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:16.168892 run osmo-stp_10.42.42.5(pid=21103): stderr: | 20221213123214473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123214473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123214474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123214474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123214474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123214474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123214475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:16.321186 run patchelf(pid=21106): Terminating (SIGINT) 12:32:16.500608 run patchelf(pid=21106): Terminated: ok {rc=0} 12:32:16.628936 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21103): Process ended prematurely: osmo-stp_10.42.42.5(pid=21103) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21103)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:32:16.639792 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:32:16.668761 run osmo-hlr_10.42.42.2(pid=21100): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21100)] 12:32:16.727535 run osmo-hlr_10.42.42.2(pid=21100): stdout: | (launched: 2022-12-13_12:32:13.272149) 12:32:16.779403 run osmo-hlr_10.42.42.2(pid=21100): stderr: | 20221213123213466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123213466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123213466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123213467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123213467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123213467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123213479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123213489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123213490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123213490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:16.830768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21089): Terminating (SIGTERM) 12:32:16.872408 run iperf3-srv_10.42.42.10(pid=21090): Terminating (SIGTERM) 12:32:16.917255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21091): Terminating (SIGTERM) 12:32:16.958877 run iperf3-srv_10.42.42.10(pid=21092): Terminating (SIGTERM) 12:32:17.003677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21093): Terminating (SIGTERM) 12:32:17.045228 run iperf3-srv_10.42.42.10(pid=21094): Terminating (SIGTERM) 12:32:17.090353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21095): Terminating (SIGTERM) 12:32:17.132261 run iperf3-srv_10.42.42.10(pid=21096): Terminating (SIGTERM) 12:32:17.177428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21099): Terminating (SIGTERM) 12:32:17.219148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21102): Terminating (SIGTERM) 12:32:17.258921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21105): Terminating (SIGTERM) 12:32:17.298580 --- ParallelTerminationStrategy: PID 21089 died... 12:32:17.317202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21089): Terminated: ok {rc=0} 12:32:17.361128 --- ParallelTerminationStrategy: PID 21090 died... 12:32:17.383658 run iperf3-srv_10.42.42.10(pid=21090): Terminated {rc=256} 12:32:17.430463 --- ParallelTerminationStrategy: PID 21091 died... 12:32:17.450946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21091): Terminated: ok {rc=0} 12:32:17.497942 --- ParallelTerminationStrategy: PID 21092 died... 12:32:17.518493 run iperf3-srv_10.42.42.10(pid=21092): Terminated {rc=256} 12:32:17.565264 --- ParallelTerminationStrategy: PID 21093 died... 12:32:17.585850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21093): Terminated: ok {rc=0} 12:32:17.632455 --- ParallelTerminationStrategy: PID 21094 died... 12:32:17.652928 run iperf3-srv_10.42.42.10(pid=21094): Terminated {rc=256} 12:32:17.699862 --- ParallelTerminationStrategy: PID 21095 died... 12:32:17.720476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21095): Terminated: ok {rc=0} 12:32:17.767236 --- ParallelTerminationStrategy: PID 21096 died... 12:32:17.787629 run iperf3-srv_10.42.42.10(pid=21096): Terminated {rc=256} 12:32:17.834316 --- ParallelTerminationStrategy: PID 21099 died... 12:32:17.854750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21099): Terminated: ok {rc=0} 12:32:17.901527 --- ParallelTerminationStrategy: PID 21102 died... 12:32:17.921991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21102): Terminated: ok {rc=0} 12:32:17.968868 --- ParallelTerminationStrategy: PID 21105 died... 12:32:17.989766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21105): Terminated: ok {rc=0} 12:32:18.078702 bus /gobi_4: Setting Powered False 12:32:19.177277 bus /gobi_4: Setting Powered False 12:32:20.290444 bus /gobi_1: Setting Powered False 12:32:21.388060 bus /gobi_1: Setting Powered False 12:32:22.505439 bus /gobi_0: Setting Powered False 12:32:23.603423 bus /gobi_0: Setting Powered False 12:32:24.718400 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:32:25.820843 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:25.833140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:32:25.901559 tst ping.py: using LAC 33965 12:32:26.017757 tst ping.py: using RAC 50 12:32:26.134248 tst ping.py: using CellId 33965 12:32:26.257759 tst ping.py: using BVCI 33966 12:32:26.366192 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:26.377429 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:26.388267 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:26.399219 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:26.412775 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:26.423870 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:26.434926 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:26.445846 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:32:26.564198 tst ping.py:19: start network... 12:32:26.779838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:27.272153 run create_hlr_db(pid=21107): Launched 12:32:27.397740 bus /gobi_6: Setting Powered False 12:32:28.456642 run create_hlr_db(pid=21107): Terminated: ok {rc=0} 12:32:28.892092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21109): Launched 12:32:29.213269 run osmo-hlr_10.42.42.2(pid=21110): Launched 12:32:29.337098 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:29.889227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21112): Launched 12:32:30.206899 run osmo-stp_10.42.42.5(pid=21113): Launched 12:32:30.331273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:30.898644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21115): Launched 12:32:31.033774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:31.308505 run patchelf(pid=21116): Launched 12:32:31.500568 run osmo-stp_10.42.42.5(pid=21113): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21113)] 12:32:31.641045 run osmo-stp_10.42.42.5(pid=21113): stdout: | (launched: 2022-12-13_12:32:30.148467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:31.781382 run osmo-stp_10.42.42.5(pid=21113): stderr: | 20221213123230338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123230338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123230339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123230339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123230339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123230339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123230340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:31.922017 run osmo-stp_10.42.42.5(pid=21113): stdout: | (launched: 2022-12-13_12:32:30.148467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:32.055866 run osmo-stp_10.42.42.5(pid=21113): stderr: | 20221213123230338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123230338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123230339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123230339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123230339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123230339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123230340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:32.214086 run patchelf(pid=21116): Terminating (SIGINT) 12:32:32.392516 run patchelf(pid=21116): Terminated: ok {rc=0} 12:32:32.521088 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21113): Process ended prematurely: osmo-stp_10.42.42.5(pid=21113) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21113)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 12:32:32.531148 tst ping.py:22: Test FAILED (6.7 sec) 12:32:32.559262 run osmo-hlr_10.42.42.2(pid=21110): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21110)] 12:32:32.610206 run osmo-hlr_10.42.42.2(pid=21110): stdout: | (launched: 2022-12-13_12:32:29.154632) 12:32:32.662390 run osmo-hlr_10.42.42.2(pid=21110): stderr: | 20221213123229350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123229350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123229350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123229350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123229350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123229350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123229373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123229383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123229383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123229383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:32.715100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21109): Terminating (SIGTERM) 12:32:32.757177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21112): Terminating (SIGTERM) 12:32:32.799489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21115): Terminating (SIGTERM) 12:32:32.842001 --- ParallelTerminationStrategy: PID 21109 died... 12:32:32.862659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21109): Terminated: ok {rc=0} 12:32:32.909469 --- ParallelTerminationStrategy: PID 21112 died... 12:32:32.929536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21112): Terminated: ok {rc=0} 12:32:32.975853 --- ParallelTerminationStrategy: PID 21115 died... 12:32:32.995723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21115): Terminated: ok {rc=0} 12:32:33.083975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:32:34.172815 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:34.184518 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:32:34.252261 tst ping_idle_ping.py: using LAC 33966 12:32:34.380417 tst ping_idle_ping.py: using RAC 51 12:32:34.510678 tst ping_idle_ping.py: using CellId 33966 12:32:34.635343 tst ping_idle_ping.py: using BVCI 33967 12:32:34.752627 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:34.764443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:34.775876 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:34.787265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:34.798963 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:34.810697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:34.822472 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:34.834149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:32:34.948731 tst ping_idle_ping.py:24: start network... 12:32:35.148731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:35.612662 run create_hlr_db(pid=21117): Launched 12:32:35.735732 bus /gobi_6: Setting Powered False 12:32:36.795228 run create_hlr_db(pid=21117): Terminated: ok {rc=0} 12:32:37.232664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21119): Launched 12:32:37.552028 run osmo-hlr_10.42.42.2(pid=21120): Launched 12:32:37.674658 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:38.202347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21122): Launched 12:32:38.501226 run osmo-stp_10.42.42.5(pid=21123): Launched 12:32:38.614662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:39.128872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21125): Launched 12:32:39.243021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:39.494698 run patchelf(pid=21126): Launched 12:32:39.660544 run osmo-stp_10.42.42.5(pid=21123): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21123)] 12:32:39.786511 run osmo-stp_10.42.42.5(pid=21123): stdout: | (launched: 2022-12-13_12:32:38.445983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:39.913921 run osmo-stp_10.42.42.5(pid=21123): stderr: | 20221213123238616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123238616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123238617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123238617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123238618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123238618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123238618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:40.041298 run osmo-stp_10.42.42.5(pid=21123): stdout: | (launched: 2022-12-13_12:32:38.445983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:40.163250 run osmo-stp_10.42.42.5(pid=21123): stderr: | 20221213123238616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123238616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123238617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123238617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123238618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123238618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123238618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:40.307514 run patchelf(pid=21126): Terminating (SIGINT) 12:32:40.474320 run patchelf(pid=21126): Terminated: ok {rc=0} 12:32:40.594378 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21123): Process ended prematurely: osmo-stp_10.42.42.5(pid=21123) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21123)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:32:40.603388 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 12:32:40.630010 run osmo-hlr_10.42.42.2(pid=21120): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21120)] 12:32:40.676818 run osmo-hlr_10.42.42.2(pid=21120): stdout: | (launched: 2022-12-13_12:32:37.493551) 12:32:40.725879 run osmo-hlr_10.42.42.2(pid=21120): stderr: | 20221213123237692 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123237692 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123237692 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123237692 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123237692 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123237692 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123237703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123237712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123237712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123237712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:40.775463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21119): Terminating (SIGTERM) 12:32:40.815284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21122): Terminating (SIGTERM) 12:32:40.854761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21125): Terminating (SIGTERM) 12:32:40.894440 --- ParallelTerminationStrategy: PID 21119 died... 12:32:40.913535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21119): Terminated: ok {rc=0} 12:32:40.957134 --- ParallelTerminationStrategy: PID 21122 died... 12:32:40.975629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21122): Terminated: ok {rc=0} 12:32:41.019118 --- ParallelTerminationStrategy: PID 21125 died... 12:32:41.037674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21125): Terminated: ok {rc=0} 12:32:41.121104 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:32:42.429161 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:42.436055 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:32:42.466996 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:32:42.506743 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:32:42.594481 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:32:42.623804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:32:42.662976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:32:43.259183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:32:43.308533 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:43.319876 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:32:43.388193 tst cs_paging_gprs_active.py: using LAC 33967 12:32:43.508166 tst cs_paging_gprs_active.py: using RAC 52 12:32:43.639553 tst cs_paging_gprs_active.py: using CellId 33967 12:32:43.760063 tst cs_paging_gprs_active.py: using BVCI 33968 12:32:43.870871 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:43.882061 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:43.893183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:43.904174 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:43.915729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:43.927261 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:43.938713 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:43.950035 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:43.961527 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:32:44.083026 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:32:44.200672 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:32:44.407129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:32:44.714014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21131): Launched 12:32:44.983526 run iperf3-srv_10.42.42.10(pid=21132): Launched 12:32:45.098273 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:32:45.302520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:32:45.609164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21133): Launched 12:32:45.888313 run iperf3-srv_10.42.42.10(pid=21134): Launched 12:32:46.027182 tst cs_paging_gprs_active.py:38: start network... 12:32:46.254599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:46.774266 run create_hlr_db(pid=21135): Launched 12:32:46.934699 bus /gobi_6: Setting Powered False 12:32:47.996144 run create_hlr_db(pid=21135): Terminated: ok {rc=0} 12:32:48.442600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Launched 12:32:48.770775 run osmo-hlr_10.42.42.2(pid=21138): Launched 12:32:48.897851 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:49.461775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Launched 12:32:49.788336 run osmo-stp_10.42.42.5(pid=21141): Launched 12:32:49.914576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:50.475974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21143): Launched 12:32:50.603419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:50.886699 run patchelf(pid=21144): Launched 12:32:51.069215 run osmo-stp_10.42.42.5(pid=21141): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] 12:32:51.207750 run osmo-stp_10.42.42.5(pid=21141): stdout: | (launched: 2022-12-13_12:32:49.728430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:51.348731 run osmo-stp_10.42.42.5(pid=21141): stderr: | 20221213123249919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123249920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123249920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123249920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123249921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123249921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123249921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:51.489221 run osmo-stp_10.42.42.5(pid=21141): stdout: | (launched: 2022-12-13_12:32:49.728430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:51.623460 run osmo-stp_10.42.42.5(pid=21141): stderr: | 20221213123249919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123249920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123249920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123249920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123249921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123249921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123249921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:51.782395 run patchelf(pid=21144): Terminating (SIGINT) 12:32:51.966136 run patchelf(pid=21144): Terminated: ok {rc=0} 12:32:52.098193 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21141): Process ended prematurely: osmo-stp_10.42.42.5(pid=21141) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:32:52.108555 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:32:52.137364 run osmo-hlr_10.42.42.2(pid=21138): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21138)] 12:32:52.188065 run osmo-hlr_10.42.42.2(pid=21138): stdout: | (launched: 2022-12-13_12:32:48.709939) 12:32:52.241108 run osmo-hlr_10.42.42.2(pid=21138): stderr: | 20221213123248907 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123248907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123248907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123248907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123248907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123248907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123248920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123248930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123248931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123248931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:52.293708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21131): Terminating (SIGTERM) 12:32:52.335913 run iperf3-srv_10.42.42.10(pid=21132): Terminating (SIGTERM) 12:32:52.378448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21133): Terminating (SIGTERM) 12:32:52.420608 run iperf3-srv_10.42.42.10(pid=21134): Terminating (SIGTERM) 12:32:52.463222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Terminating (SIGTERM) 12:32:52.505393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Terminating (SIGTERM) 12:32:52.547885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21143): Terminating (SIGTERM) 12:32:52.590352 --- ParallelTerminationStrategy: PID 21131 died... 12:32:52.610998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21131): Terminated: ok {rc=0} 12:32:52.657803 --- ParallelTerminationStrategy: PID 21132 died... 12:32:52.677806 run iperf3-srv_10.42.42.10(pid=21132): Terminated {rc=256} 12:32:52.724042 --- ParallelTerminationStrategy: PID 21133 died... 12:32:52.744075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21133): Terminated: ok {rc=0} 12:32:52.790547 --- ParallelTerminationStrategy: PID 21134 died... 12:32:52.810624 run iperf3-srv_10.42.42.10(pid=21134): Terminated {rc=256} 12:32:52.857107 --- ParallelTerminationStrategy: PID 21137 died... 12:32:52.877104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Terminated: ok {rc=0} 12:32:52.923648 --- ParallelTerminationStrategy: PID 21140 died... 12:32:52.943731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Terminated: ok {rc=0} 12:32:52.990081 --- ParallelTerminationStrategy: PID 21143 died... 12:32:53.010225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21143): Terminated: ok {rc=0} 12:32:53.098737 bus /gobi_0: Setting Powered False 12:32:54.197877 bus /gobi_0: Setting Powered False 12:32:55.315554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:32:56.459991 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:56.471757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:32:56.538859 tst iperf3.py: using LAC 33968 12:32:56.657787 tst iperf3.py: using RAC 53 12:32:56.777354 tst iperf3.py: using CellId 33968 12:32:56.898065 tst iperf3.py: using BVCI 33969 12:32:57.010319 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:57.021483 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:57.032368 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:57.043421 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:57.054389 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:57.065304 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:57.076184 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:57.086963 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:32:57.098128 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:32:57.212048 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:32:57.416579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:32:57.721809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21145): Launched 12:32:57.988493 run iperf3-srv_10.42.42.10(pid=21146): Launched 12:32:58.102099 tst iperf3.py:8: start network... 12:32:58.305114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:58.774148 run create_hlr_db(pid=21147): Launched 12:32:58.899813 bus /gobi_6: Setting Powered False 12:32:59.963457 run create_hlr_db(pid=21147): Terminated: ok {rc=0} 12:33:00.417416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21149): Launched 12:33:00.744832 run osmo-hlr_10.42.42.2(pid=21150): Launched 12:33:00.938377 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:01.697736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21155): Launched 12:33:02.033748 run osmo-stp_10.42.42.5(pid=21156): Launched 12:33:02.155536 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:33:02.799622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21158): Launched 12:33:02.916284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:33:03.173469 run patchelf(pid=21160): Launched 12:33:03.343638 run osmo-stp_10.42.42.5(pid=21156): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21156)] 12:33:03.473507 run osmo-stp_10.42.42.5(pid=21156): stdout: | (launched: 2022-12-13_12:33:01.965481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:03.604506 run osmo-stp_10.42.42.5(pid=21156): stderr: | 20221213123302305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123302305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123302305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123302306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123302306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123302306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123302307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:03.735768 run osmo-stp_10.42.42.5(pid=21156): stdout: | (launched: 2022-12-13_12:33:01.965481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:03.860918 run osmo-stp_10.42.42.5(pid=21156): stderr: | 20221213123302305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123302305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123302305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123302306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123302306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123302306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123302307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:04.008834 run patchelf(pid=21160): Terminating (SIGINT) 12:33:04.180219 run patchelf(pid=21160): Terminated: ok {rc=0} 12:33:04.304058 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21156): Process ended prematurely: osmo-stp_10.42.42.5(pid=21156) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21156)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 12:33:04.313816 tst iperf3.py:8: Test FAILED (7.9 sec) 12:33:04.340791 run osmo-hlr_10.42.42.2(pid=21150): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21150)] 12:33:04.388620 run osmo-hlr_10.42.42.2(pid=21150): stdout: | (launched: 2022-12-13_12:33:00.685296) 12:33:04.437821 run osmo-hlr_10.42.42.2(pid=21150): stderr: | 20221213123300966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123300966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123300966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123300966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123300966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123300966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123300985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123301004 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123301004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123301004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:04.487308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21145): Terminating (SIGTERM) 12:33:04.527343 run iperf3-srv_10.42.42.10(pid=21146): Terminating (SIGTERM) 12:33:04.567402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21149): Terminating (SIGTERM) 12:33:04.606985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21155): Terminating (SIGTERM) 12:33:04.646816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21158): Terminating (SIGTERM) 12:33:04.686792 --- ParallelTerminationStrategy: PID 21145 died... 12:33:04.705967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21145): Terminated: ok {rc=0} 12:33:04.749951 --- ParallelTerminationStrategy: PID 21146 died... 12:33:04.768415 run iperf3-srv_10.42.42.10(pid=21146): Terminated {rc=256} 12:33:04.812105 --- ParallelTerminationStrategy: PID 21149 died... 12:33:04.830805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21149): Terminated: ok {rc=0} 12:33:04.874380 --- ParallelTerminationStrategy: PID 21155 died... 12:33:04.893108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21155): Terminated: ok {rc=0} 12:33:04.936731 --- ParallelTerminationStrategy: PID 21158 died... 12:33:04.955421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21158): Terminated: ok {rc=0} 12:33:05.041812 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:33:06.189873 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:06.201650 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:33:06.268255 tst iperf3m4.py: using LAC 33969 12:33:06.403095 tst iperf3m4.py: using RAC 54 12:33:06.530356 tst iperf3m4.py: using CellId 33969 12:33:06.657165 tst iperf3m4.py: using BVCI 33970 12:33:06.774914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:06.786741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:06.798354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:06.809809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:06.821623 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:06.833321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:06.845303 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:06.856895 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:06.868806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:33:06.985721 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:33:07.107820 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:33:07.228333 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:33:07.346227 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:33:07.551549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:33:07.856785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21161): Launched 12:33:08.122246 run iperf3-srv_10.42.42.10(pid=21162): Launched 12:33:08.237797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:33:08.442128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:33:08.748407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21163): Launched 12:33:09.014682 run iperf3-srv_10.42.42.10(pid=21164): Launched 12:33:09.128463 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:33:09.332361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:33:09.639098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21165): Launched 12:33:09.905156 run iperf3-srv_10.42.42.10(pid=21166): Launched 12:33:10.018929 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:33:10.223618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:33:10.529634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21167): Launched 12:33:10.797253 run iperf3-srv_10.42.42.10(pid=21168): Launched 12:33:10.911090 tst iperf3m4.py:8: start network... 12:33:11.114465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:11.584331 run create_hlr_db(pid=21169): Launched 12:33:11.710216 bus /gobi_6: Setting Powered False 12:33:12.771995 run create_hlr_db(pid=21169): Terminated: ok {rc=0} 12:33:13.217589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21171): Launched 12:33:13.546831 run osmo-hlr_10.42.42.2(pid=21172): Launched 12:33:13.672787 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:14.238003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21174): Launched 12:33:14.565411 run osmo-stp_10.42.42.5(pid=21175): Launched 12:33:14.691668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:33:15.256234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21177): Launched 12:33:15.383184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:33:15.659492 run patchelf(pid=21178): Launched 12:33:15.845598 run osmo-stp_10.42.42.5(pid=21175): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21175)] 12:33:15.987518 run osmo-stp_10.42.42.5(pid=21175): stdout: | (launched: 2022-12-13_12:33:14.505433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:16.129954 run osmo-stp_10.42.42.5(pid=21175): stderr: | 20221213123314695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123314695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123314695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123314696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123314696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123314696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123314696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:16.273459 run osmo-stp_10.42.42.5(pid=21175): stdout: | (launched: 2022-12-13_12:33:14.505433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:16.410520 run osmo-stp_10.42.42.5(pid=21175): stderr: | 20221213123314695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123314695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123314695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123314696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123314696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123314696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123314696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:16.572427 run patchelf(pid=21178): Terminating (SIGINT) 12:33:16.758545 run patchelf(pid=21178): Terminated: ok {rc=0} 12:33:16.893522 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21175): Process ended prematurely: osmo-stp_10.42.42.5(pid=21175) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21175)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:33:16.905068 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:33:16.935226 run osmo-hlr_10.42.42.2(pid=21172): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21172)] 12:33:16.989626 run osmo-hlr_10.42.42.2(pid=21172): stdout: | (launched: 2022-12-13_12:33:13.486598) 12:33:17.043783 run osmo-hlr_10.42.42.2(pid=21172): stderr: | 20221213123313683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123313683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123313683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123313683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123313683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123313683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123313695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123313704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123313704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123313704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:17.098588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21161): Terminating (SIGTERM) 12:33:17.142283 run iperf3-srv_10.42.42.10(pid=21162): Terminating (SIGTERM) 12:33:17.187074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21163): Terminating (SIGTERM) 12:33:17.229800 run iperf3-srv_10.42.42.10(pid=21164): Terminating (SIGTERM) 12:33:17.272709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21165): Terminating (SIGTERM) 12:33:17.314974 run iperf3-srv_10.42.42.10(pid=21166): Terminating (SIGTERM) 12:33:17.357459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21167): Terminating (SIGTERM) 12:33:17.399484 run iperf3-srv_10.42.42.10(pid=21168): Terminating (SIGTERM) 12:33:17.441626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21171): Terminating (SIGTERM) 12:33:17.483953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21174): Terminating (SIGTERM) 12:33:17.526192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21177): Terminating (SIGTERM) 12:33:17.568531 --- ParallelTerminationStrategy: PID 21161 died... 12:33:17.589238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21161): Terminated: ok {rc=0} 12:33:17.635972 --- ParallelTerminationStrategy: PID 21162 died... 12:33:17.655851 run iperf3-srv_10.42.42.10(pid=21162): Terminated {rc=256} 12:33:17.702487 --- ParallelTerminationStrategy: PID 21163 died... 12:33:17.722528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21163): Terminated: ok {rc=0} 12:33:17.769067 --- ParallelTerminationStrategy: PID 21164 died... 12:33:17.789421 run iperf3-srv_10.42.42.10(pid=21164): Terminated {rc=256} 12:33:17.836031 --- ParallelTerminationStrategy: PID 21165 died... 12:33:17.856056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21165): Terminated: ok {rc=0} 12:33:17.902667 --- ParallelTerminationStrategy: PID 21166 died... 12:33:17.922720 run iperf3-srv_10.42.42.10(pid=21166): Terminated {rc=256} 12:33:17.969349 --- ParallelTerminationStrategy: PID 21167 died... 12:33:17.989480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21167): Terminated: ok {rc=0} 12:33:18.036034 --- ParallelTerminationStrategy: PID 21168 died... 12:33:18.056061 run iperf3-srv_10.42.42.10(pid=21168): Terminated {rc=256} 12:33:18.102735 --- ParallelTerminationStrategy: PID 21171 died... 12:33:18.122767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21171): Terminated: ok {rc=0} 12:33:18.169323 --- ParallelTerminationStrategy: PID 21174 died... 12:33:18.189328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21174): Terminated: ok {rc=0} 12:33:18.235863 --- ParallelTerminationStrategy: PID 21177 died... 12:33:18.256141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21177): Terminated: ok {rc=0} 12:33:18.345703 bus /gobi_4: Setting Powered False 12:33:19.445450 bus /gobi_4: Setting Powered False 12:33:20.562778 bus /gobi_1: Setting Powered False 12:33:21.662223 bus /gobi_1: Setting Powered False 12:33:22.777804 bus /gobi_0: Setting Powered False 12:33:23.876323 bus /gobi_0: Setting Powered False 12:33:24.992609 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:33:26.094648 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:26.107056 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:33:26.176134 tst ping.py: using LAC 33970 12:33:26.303042 tst ping.py: using RAC 55 12:33:26.427620 tst ping.py: using CellId 33970 12:33:26.546660 tst ping.py: using BVCI 33971 12:33:26.657370 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:26.668594 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:26.679657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:26.690709 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:26.702788 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:26.714373 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:26.726033 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:26.737654 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:33:26.857979 tst ping.py:19: start network... 12:33:27.073392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:27.566539 run create_hlr_db(pid=21179): Launched 12:33:27.690028 bus /gobi_6: Setting Powered False 12:33:28.753855 run create_hlr_db(pid=21179): Terminated: ok {rc=0} 12:33:29.181485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21181): Launched 12:33:29.481377 run osmo-hlr_10.42.42.2(pid=21182): Launched 12:33:29.595716 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:30.127108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21184): Launched 12:33:30.426247 run osmo-stp_10.42.42.5(pid=21185): Launched 12:33:30.540225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:33:31.093037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21187): Launched 12:33:31.234149 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:33:31.511766 run patchelf(pid=21188): Launched 12:33:31.696680 run osmo-stp_10.42.42.5(pid=21185): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21185)] 12:33:31.836938 run osmo-stp_10.42.42.5(pid=21185): stdout: | (launched: 2022-12-13_12:33:30.370485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:32.025946 run osmo-stp_10.42.42.5(pid=21185): stderr: | 20221213123330539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123330540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123330540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123330540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123330541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123330541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123330541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:32.167757 run osmo-stp_10.42.42.5(pid=21185): stdout: | (launched: 2022-12-13_12:33:30.370485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:32.301599 run osmo-stp_10.42.42.5(pid=21185): stderr: | 20221213123330539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123330540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123330540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123330540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123330541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123330541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123330541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:32.457280 run patchelf(pid=21188): Terminating (SIGINT) 12:33:32.635773 run patchelf(pid=21188): Terminated: ok {rc=0} 12:33:32.764519 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21185): Process ended prematurely: osmo-stp_10.42.42.5(pid=21185) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21185)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 12:33:32.774469 tst ping.py:22: Test FAILED (6.7 sec) 12:33:32.802852 run osmo-hlr_10.42.42.2(pid=21182): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21182)] 12:33:32.853916 run osmo-hlr_10.42.42.2(pid=21182): stdout: | (launched: 2022-12-13_12:33:29.426075) 12:33:32.906570 run osmo-hlr_10.42.42.2(pid=21182): stderr: | 20221213123329602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123329602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123329602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123329602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123329602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123329602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123329615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123329625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123329625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123329625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:32.959589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21181): Terminating (SIGTERM) 12:33:33.001790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21184): Terminating (SIGTERM) 12:33:33.044400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21187): Terminating (SIGTERM) 12:33:33.087139 --- ParallelTerminationStrategy: PID 21181 died... 12:33:33.107742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21181): Terminated: ok {rc=0} 12:33:33.154417 --- ParallelTerminationStrategy: PID 21184 died... 12:33:33.174507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21184): Terminated: ok {rc=0} 12:33:33.221182 --- ParallelTerminationStrategy: PID 21187 died... 12:33:33.241172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21187): Terminated: ok {rc=0} 12:33:33.330135 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:33:34.416352 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:34.428321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:33:34.499490 tst ping_idle_ping.py: using LAC 33971 12:33:34.615950 tst ping_idle_ping.py: using RAC 56 12:33:34.731813 tst ping_idle_ping.py: using CellId 33971 12:33:34.848350 tst ping_idle_ping.py: using BVCI 33972 12:33:34.956418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:34.967649 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:34.978601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:34.989676 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:35.000523 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:35.011577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:35.023304 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:33:35.034522 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:33:35.149342 tst ping_idle_ping.py:24: start network... 12:33:35.349861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:35.813811 run create_hlr_db(pid=21189): Launched 12:33:35.937480 bus /gobi_6: Setting Powered False 12:33:36.998013 run create_hlr_db(pid=21189): Terminated: ok {rc=0} 12:33:37.436889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21191): Launched 12:33:37.759459 run osmo-hlr_10.42.42.2(pid=21192): Launched 12:33:37.883491 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:38.436843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21194): Launched 12:33:38.758149 run osmo-stp_10.42.42.5(pid=21195): Launched 12:33:38.882631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:33:39.436795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21197): Launched 12:33:39.560893 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:33:39.831238 run patchelf(pid=21198): Launched 12:33:40.011295 run osmo-stp_10.42.42.5(pid=21195): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21195)] 12:33:40.147323 run osmo-stp_10.42.42.5(pid=21195): stdout: | (launched: 2022-12-13_12:33:38.698938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:40.285457 run osmo-stp_10.42.42.5(pid=21195): stderr: | 20221213123338892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123338892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123338892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123338893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123338893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123338893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123338893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:40.423672 run osmo-stp_10.42.42.5(pid=21195): stdout: | (launched: 2022-12-13_12:33:38.698938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:40.555310 run osmo-stp_10.42.42.5(pid=21195): stderr: | 20221213123338892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123338892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123338892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123338893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123338893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123338893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123338893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:40.711553 run patchelf(pid=21198): Terminating (SIGINT) 12:33:40.891148 run patchelf(pid=21198): Terminated: ok {rc=0} 12:33:41.020183 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21195): Process ended prematurely: osmo-stp_10.42.42.5(pid=21195) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21195)] [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:33:41.030042 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:33:41.058438 run osmo-hlr_10.42.42.2(pid=21192): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21192)] 12:33:41.109588 run osmo-hlr_10.42.42.2(pid=21192): stdout: | (launched: 2022-12-13_12:33:37.700560) 12:33:41.162355 run osmo-hlr_10.42.42.2(pid=21192): stderr: | 20221213123337898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123337898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123337898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123337898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123337898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123337898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123337910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123337919 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123337919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123337919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:41.215617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21191): Terminating (SIGTERM) 12:33:41.257795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21194): Terminating (SIGTERM) 12:33:41.300539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21197): Terminating (SIGTERM) 12:33:41.343510 --- ParallelTerminationStrategy: PID 21191 died... 12:33:41.364243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21191): Terminated: ok {rc=0} 12:33:41.411162 --- ParallelTerminationStrategy: PID 21194 died... 12:33:41.431340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21194): Terminated: ok {rc=0} 12:33:41.478088 --- ParallelTerminationStrategy: PID 21197 died... 12:33:41.498351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21197): Terminated: ok {rc=0} 12:33:41.586853 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:33:42.900593 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:42.907618 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:33:42.937632 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:33:42.973937 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:33:43.026054 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:33:43.056352 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:33:43.092227 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:33:43.655334 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:33:43.660691 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:33:43.672579 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:33:43.739446 tst switch_tch_pdch.py: using LAC 33972 12:33:43.862571 tst switch_tch_pdch.py: using RAC 57 12:33:43.985328 tst switch_tch_pdch.py: using CellId 33972 12:33:44.108472 tst switch_tch_pdch.py: using BVCI 33973 12:33:44.223906 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:33:44.235753 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:33:44.247469 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:33:44.259201 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:33:44.271511 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:33:44.283567 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:33:44.295709 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:33:44.307671 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:33:44.426226 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:33:44.541269 tst switch_tch_pdch.py:51: start network... 12:33:44.741963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:45.204570 run create_hlr_db(pid=21202): Launched 12:33:45.327037 bus /gobi_6: Setting Powered False 12:33:46.386027 run create_hlr_db(pid=21202): Terminated: ok {rc=0} 12:33:46.813902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21204): Launched 12:33:47.132290 run osmo-hlr_10.42.42.2(pid=21205): Launched 12:33:47.258253 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:47.811736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21207): Launched 12:33:48.131984 run osmo-stp_10.42.42.5(pid=21208): Launched 12:33:48.255302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:33:48.808352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21210): Launched 12:33:48.930942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:33:49.201042 run patchelf(pid=21211): Launched 12:33:49.379471 run osmo-stp_10.42.42.5(pid=21208): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21208)] 12:33:49.514763 run osmo-stp_10.42.42.5(pid=21208): stdout: | (launched: 2022-12-13_12:33:48.073124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:49.651746 run osmo-stp_10.42.42.5(pid=21208): stderr: | 20221213123348264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123348264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123348264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123348265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123348265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123348265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123348265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:49.789230 run osmo-stp_10.42.42.5(pid=21208): stdout: | (launched: 2022-12-13_12:33:48.073124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:49.920148 run osmo-stp_10.42.42.5(pid=21208): stderr: | 20221213123348264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123348264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123348264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123348265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123348265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123348265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123348265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:50.075379 run patchelf(pid=21211): Terminating (SIGINT) 12:33:50.253559 run patchelf(pid=21211): Terminated: ok {rc=0} 12:33:50.382451 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21208): Process ended prematurely: osmo-stp_10.42.42.5(pid=21208) [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21208)] [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:33:50.392249 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:33:50.420412 run osmo-hlr_10.42.42.2(pid=21205): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21205)] 12:33:50.471184 run osmo-hlr_10.42.42.2(pid=21205): stdout: | (launched: 2022-12-13_12:33:47.076217) 12:33:50.523596 run osmo-hlr_10.42.42.2(pid=21205): stderr: | 20221213123347268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123347268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123347269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123347269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123347269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123347269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123347280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123347289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123347289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123347289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:50.576756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21204): Terminating (SIGTERM) 12:33:50.618725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21207): Terminating (SIGTERM) 12:33:50.660780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21210): Terminating (SIGTERM) 12:33:50.703219 --- ParallelTerminationStrategy: PID 21204 died... 12:33:50.723798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21204): Terminated: ok {rc=0} 12:33:50.770615 --- ParallelTerminationStrategy: PID 21207 died... 12:33:50.790811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21207): Terminated: ok {rc=0} 12:33:50.837317 --- ParallelTerminationStrategy: PID 21210 died... 12:33:50.857377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21210): Terminated: ok {rc=0} 12:33:50.946165 bus /gobi_0: Setting Powered False 12:33:52.046809 bus /gobi_0: Setting Powered False 12:33:53.161188 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:33:54.421660 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:54.427924 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:33:54.457770 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:33:54.494310 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:33:54.553470 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:33:54.584007 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:33:54.619765 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:33:55.169606 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:33:55.175693 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:33:55.187461 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:33:55.257552 tst switch_tch_pdch.py: using LAC 33973 12:33:55.383916 tst switch_tch_pdch.py: using RAC 58 12:33:55.500062 tst switch_tch_pdch.py: using CellId 33973 12:33:55.624874 tst switch_tch_pdch.py: using BVCI 33974 12:33:55.741000 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:33:55.752827 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:33:55.764446 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:33:55.775913 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:33:55.787708 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:33:55.800199 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:33:55.812219 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:33:55.824133 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:33:55.939903 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:33:56.058231 tst switch_tch_pdch.py:51: start network... 12:33:56.274452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:56.739709 run create_hlr_db(pid=21215): Launched 12:33:56.863307 bus /gobi_6: Setting Powered False 12:33:57.926391 run create_hlr_db(pid=21215): Terminated: ok {rc=0} 12:33:58.329449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21217): Launched 12:33:58.631202 run osmo-hlr_10.42.42.2(pid=21218): Launched 12:33:58.746949 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:59.250005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21220): Launched 12:33:59.547929 run osmo-stp_10.42.42.5(pid=21221): Launched 12:33:59.660788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:34:00.149949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21223): Launched 12:34:00.263796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:34:00.515549 run patchelf(pid=21224): Launched 12:34:00.680870 run osmo-stp_10.42.42.5(pid=21221): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21221)] 12:34:00.807312 run osmo-stp_10.42.42.5(pid=21221): stdout: | (launched: 2022-12-13_12:33:59.492608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:00.944131 run osmo-stp_10.42.42.5(pid=21221): stderr: | 20221213123359665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123359665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123359665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123359666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123359666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123359666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123359666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:01.074743 run osmo-stp_10.42.42.5(pid=21221): stdout: | (launched: 2022-12-13_12:33:59.492608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:01.199053 run osmo-stp_10.42.42.5(pid=21221): stderr: | 20221213123359665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123359665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123359665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123359666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123359666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123359666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123359666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:01.346522 run patchelf(pid=21224): Terminating (SIGINT) 12:34:01.516443 run patchelf(pid=21224): Terminated: ok {rc=0} 12:34:01.639126 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21221): Process ended prematurely: osmo-stp_10.42.42.5(pid=21221) [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21221)] [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:34:01.649283 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 12:34:01.677410 run osmo-hlr_10.42.42.2(pid=21218): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21218)] 12:34:01.726512 run osmo-hlr_10.42.42.2(pid=21218): stdout: | (launched: 2022-12-13_12:33:58.575449) 12:34:01.776845 run osmo-hlr_10.42.42.2(pid=21218): stderr: | 20221213123358750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123358750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123358751 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123358751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123358751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123358751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123358763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123358774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123358774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123358774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:01.827800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21217): Terminating (SIGTERM) 12:34:01.868678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21220): Terminating (SIGTERM) 12:34:01.909551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21223): Terminating (SIGTERM) 12:34:01.950966 --- ParallelTerminationStrategy: PID 21217 died... 12:34:01.970675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21217): Terminated: ok {rc=0} 12:34:02.017122 --- ParallelTerminationStrategy: PID 21220 died... 12:34:02.036122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21220): Terminated: ok {rc=0} 12:34:02.080542 --- ParallelTerminationStrategy: PID 21223 died... 12:34:02.099731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21223): Terminated: ok {rc=0} 12:34:02.185172 bus /gobi_0: Setting Powered False 12:34:03.281241 bus /gobi_0: Setting Powered False 12:34:04.394141 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_sms:nanobts --------------------------------------------------------------------- 12:34:05.648324 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:05.652279 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 12:34:05.676749 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 12:34:05.684162 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 12:34:05.738685 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 12:34:05.763333 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 12:34:05.770368 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 12:34:06.308645 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 12:34:06.314194 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 12:34:06.325698 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 12:34:06.364927 tst mo_mt_sms.py: using LAC 33974 12:34:06.489351 tst mo_mt_sms.py: using RAC 59 12:34:06.613240 tst mo_mt_sms.py: using CellId 33974 12:34:06.736824 tst mo_mt_sms.py: using BVCI 33975 12:34:06.853968 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 12:34:06.971965 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 12:34:07.089551 tst mo_mt_sms.py:9: start nitb and bts... 12:34:07.290996 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:34:07.900836 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21229): Launched 12:34:08.199040 run osmo-nitb_10.42.42.2(pid=21230): Launched 12:34:08.364092 run osmo-nitb_10.42.42.2(pid=21230): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21230)] 12:34:08.498158 run osmo-nitb_10.42.42.2(pid=21230): stdout: | (launched: 2022-12-13_12:34:08.143876) 12:34:08.633544 run osmo-nitb_10.42.42.2(pid=21230): stderr: | (launched: 2022-12-13_12:34:08.188048) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:34:08.768745 run osmo-nitb_10.42.42.2(pid=21230): stdout: | (launched: 2022-12-13_12:34:08.143876) 12:34:08.898279 run osmo-nitb_10.42.42.2(pid=21230): stderr: | (launched: 2022-12-13_12:34:08.188048) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21230): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21230) [trial-2389↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21230)] 12:34:09.311060 tst osmo-nitb_10.42.42.2(pid=21230): stdout: | (launched: 2022-12-13_12:34:08.143876) 12:34:09.431703 tst osmo-nitb_10.42.42.2(pid=21230): stderr: | (launched: 2022-12-13_12:34:08.188048) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:34:09.573645 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21230): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21230) [trial-2389↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21230)] [trial-2389↪nitb_sms:nanobts↪mo_mt_sms.py:11] 12:34:09.582095 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 12:34:09.588668 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21229): Terminating (SIGTERM) 12:34:09.796890 --- ParallelTerminationStrategy: PID 21229 died... 12:34:09.817232 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21229): Terminated: ok {rc=0} 12:34:09.903407 bus /sierra_3: Setting Powered False 12:34:11.001560 bus /sierra_3: Setting Powered False 12:34:12.117956 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 sms:nanobts+band-1900 --------------------------------------------------------------------- 12:34:13.321311 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:13.327655 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:34:13.352297 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:34:13.380370 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 12:34:13.433031 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:34:13.458116 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:34:13.486721 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 12:34:14.033623 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 12:34:14.039263 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:14.050575 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:34:14.088524 tst mo_mt_sms.py: using LAC 33975 12:34:14.203245 tst mo_mt_sms.py: using RAC 60 12:34:14.318204 tst mo_mt_sms.py: using CellId 33975 12:34:14.433903 tst mo_mt_sms.py: using BVCI 33976 12:34:14.540859 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:14.551629 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:14.562242 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:14.572789 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:14.583440 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:14.593917 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 12:34:14.712780 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 12:34:14.828402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:15.290195 run create_hlr_db(pid=21234): Launched 12:34:15.411532 bus /sierra_2: Setting Powered False 12:34:16.469921 run create_hlr_db(pid=21234): Terminated: ok {rc=0} 12:34:16.893114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21236): Launched 12:34:17.207805 run osmo-hlr_10.42.42.2(pid=21237): Launched 12:34:17.321660 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:17.838430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21239): Launched 12:34:18.135835 run osmo-stp_10.42.42.5(pid=21240): Launched 12:34:18.249365 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:18.788489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21242): Launched 12:34:19.087491 run osmo-msc_10.42.42.6(pid=21243): Launched 12:34:19.254720 run osmo-stp_10.42.42.5(pid=21240): ERR: Terminated: ERROR {rc=1} [trial-2389↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21240)] 12:34:19.379840 run osmo-stp_10.42.42.5(pid=21240): stdout: | (launched: 2022-12-13_12:34:18.080494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:19.505108 run osmo-stp_10.42.42.5(pid=21240): stderr: | 20221213123418251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123418252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123418252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123418252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123418253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123418253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123418253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:19.628661 run osmo-stp_10.42.42.5(pid=21240): stdout: | (launched: 2022-12-13_12:34:18.080494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:19.746687 run osmo-stp_10.42.42.5(pid=21240): stderr: | 20221213123418251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123418252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123418252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123418252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123418253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123418253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123418253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:19.888330 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21240): Process ended prematurely: osmo-stp_10.42.42.5(pid=21240) [trial-2389↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21240)] [trial-2389↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 12:34:19.896665 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 12:34:19.922421 run osmo-hlr_10.42.42.2(pid=21237): ERR: Terminated: ERROR {rc=237} [trial-2389↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21237)] 12:34:19.969413 run osmo-hlr_10.42.42.2(pid=21237): stdout: | (launched: 2022-12-13_12:34:17.152121) 12:34:20.018293 run osmo-hlr_10.42.42.2(pid=21237): stderr: | 20221213123417328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123417328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123417328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123417328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123417328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123417328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123417341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123417350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123417350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123417350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:20.086797 run osmo-msc_10.42.42.6(pid=21243): ERR: Terminated: ERROR {rc=2} [trial-2389↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21243)] 12:34:20.133884 run osmo-msc_10.42.42.6(pid=21243): stdout: | (launched: 2022-12-13_12:34:19.031055) 12:34:20.182411 run osmo-msc_10.42.42.6(pid=21243): stderr: | 20221213123419304 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123419304 DLGLOBAL DEBUG validating counter group 0x7fba3fd97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123419304 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123419304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123419304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123419305 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123419306 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123419307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123419307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123419307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:20.231534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21236): Terminating (SIGTERM) 12:34:20.270908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21239): Terminating (SIGTERM) 12:34:20.309925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21242): Terminating (SIGTERM) 12:34:20.349275 --- ParallelTerminationStrategy: PID 21236 died... 12:34:20.367960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21236): Terminated: ok {rc=0} 12:34:20.411611 --- ParallelTerminationStrategy: PID 21239 died... 12:34:20.430072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21239): Terminated: ok {rc=0} 12:34:20.473326 --- ParallelTerminationStrategy: PID 21242 died... 12:34:20.491761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21242): Terminated: ok {rc=0} 12:34:20.577566 bus /sierra_3: Setting Powered False 12:34:21.676338 bus /sierra_3: Setting Powered False 12:34:22.791956 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 12:34:24.017677 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:24.022611 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:34:24.046136 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 12:34:24.052778 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 12:34:24.088395 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:34:24.112625 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 12:34:24.119318 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 12:34:24.639108 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 12:34:24.645561 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 12:34:24.656921 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:34:24.696139 tst assert_extension.py: using LAC 33976 12:34:24.821995 tst assert_extension.py: using RAC 61 12:34:24.946861 tst assert_extension.py: using CellId 33976 12:34:25.071793 tst assert_extension.py: using BVCI 33977 12:34:25.187799 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 12:34:25.300802 tst assert_extension.py:10: start nitb and bts... 12:34:25.501169 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:34:26.108760 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21248): Launched 12:34:26.407392 run osmo-nitb_10.42.42.2(pid=21249): Launched 12:34:26.572504 run osmo-nitb_10.42.42.2(pid=21249): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21249)] 12:34:26.706004 run osmo-nitb_10.42.42.2(pid=21249): stdout: | (launched: 2022-12-13_12:34:26.352252) 12:34:26.841285 run osmo-nitb_10.42.42.2(pid=21249): stderr: | (launched: 2022-12-13_12:34:26.396473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:34:26.976207 run osmo-nitb_10.42.42.2(pid=21249): stdout: | (launched: 2022-12-13_12:34:26.352252) 12:34:27.105436 run osmo-nitb_10.42.42.2(pid=21249): stderr: | (launched: 2022-12-13_12:34:26.396473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21249) [trial-2389↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21249)] 12:34:27.519796 tst osmo-nitb_10.42.42.2(pid=21249): stdout: | (launched: 2022-12-13_12:34:26.352252) 12:34:27.640063 tst osmo-nitb_10.42.42.2(pid=21249): stderr: | (launched: 2022-12-13_12:34:26.396473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:34:27.782435 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21249) [trial-2389↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21249)] [trial-2389↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 12:34:27.790895 tst assert_extension.py:12: Test FAILED (3.1 sec) 12:34:27.797553 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21248): Terminating (SIGTERM) 12:34:28.006095 --- ParallelTerminationStrategy: PID 21248 died... 12:34:28.027891 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21248): Terminated: ok {rc=0} 12:34:28.115581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 ussd:nanobts+band-1900 --------------------------------------------------------------------- 12:34:29.284668 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:29.289996 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:34:29.314273 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:34:29.340553 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 12:34:29.376482 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:34:29.401591 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:34:29.429457 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 12:34:29.955954 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 12:34:29.960902 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:29.972073 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:34:30.009438 tst assert_extension.py: using LAC 33977 12:34:30.136511 tst assert_extension.py: using RAC 62 12:34:30.261462 tst assert_extension.py: using CellId 33977 12:34:30.389455 tst assert_extension.py: using BVCI 33978 12:34:30.499540 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:30.510349 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:30.520879 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:30.531425 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:30.542269 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:34:30.552778 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 12:34:30.671057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:31.175899 run create_hlr_db(pid=21253): Launched 12:34:31.333039 bus /sierra_2: Setting Powered False 12:34:32.395007 run create_hlr_db(pid=21253): Terminated: ok {rc=0} 12:34:32.888926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21255): Launched 12:34:33.187989 run osmo-hlr_10.42.42.2(pid=21256): Launched 12:34:33.303375 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:33.831685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21258): Launched 12:34:34.151699 run osmo-stp_10.42.42.5(pid=21259): Launched 12:34:34.273999 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:34.852912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21261): Launched 12:34:35.172036 run osmo-msc_10.42.42.6(pid=21262): Launched 12:34:35.350355 run osmo-stp_10.42.42.5(pid=21259): ERR: Terminated: ERROR {rc=1} [trial-2389↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21259)] 12:34:35.485814 run osmo-stp_10.42.42.5(pid=21259): stdout: | (launched: 2022-12-13_12:34:34.092775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:35.622114 run osmo-stp_10.42.42.5(pid=21259): stderr: | 20221213123434283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123434283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123434283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123434284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123434284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123434284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123434284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:35.756442 run osmo-stp_10.42.42.5(pid=21259): stdout: | (launched: 2022-12-13_12:34:34.092775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:35.883837 run osmo-stp_10.42.42.5(pid=21259): stderr: | 20221213123434283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123434283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123434283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123434284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123434284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123434284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123434284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:36.035800 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21259): Process ended prematurely: osmo-stp_10.42.42.5(pid=21259) [trial-2389↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21259)] [trial-2389↪ussd:nanobts+band-1900↪assert_extension.py:17] 12:34:36.045001 tst assert_extension.py:17: Test FAILED (6.1 sec) 12:34:36.072331 run osmo-hlr_10.42.42.2(pid=21256): ERR: Terminated: ERROR {rc=237} [trial-2389↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21256)] 12:34:36.123132 run osmo-hlr_10.42.42.2(pid=21256): stdout: | (launched: 2022-12-13_12:34:33.132801) 12:34:36.175253 run osmo-hlr_10.42.42.2(pid=21256): stderr: | 20221213123433308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123433308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123433308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123433308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123433308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123433309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123433321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123433330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123433330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123433330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:36.247770 run osmo-msc_10.42.42.6(pid=21262): ERR: Terminated: ERROR {rc=2} [trial-2389↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21262)] 12:34:36.297681 run osmo-msc_10.42.42.6(pid=21262): stdout: | (launched: 2022-12-13_12:34:35.113057) 12:34:36.349515 run osmo-msc_10.42.42.6(pid=21262): stderr: | 20221213123435434 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123435434 DLGLOBAL DEBUG validating counter group 0x7fa70e148c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123435435 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123435435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123435435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123435435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123435437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123435437 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123435437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123435437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:36.402399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21255): Terminating (SIGTERM) 12:34:36.443994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21258): Terminating (SIGTERM) 12:34:36.486200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21261): Terminating (SIGTERM) 12:34:36.529173 --- ParallelTerminationStrategy: PID 21255 died... 12:34:36.549539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21255): Terminated: ok {rc=0} 12:34:36.596272 --- ParallelTerminationStrategy: PID 21258 died... 12:34:36.616231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21258): Terminated: ok {rc=0} 12:34:36.662891 --- ParallelTerminationStrategy: PID 21261 died... 12:34:36.682810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21261): Terminated: ok {rc=0} 12:34:36.771582 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:34:37.973030 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:37.980794 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:34:38.005134 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:34:38.032368 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:34:38.084386 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:34:38.108284 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:34:38.134916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:34:38.687410 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:34:38.737450 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:38.748852 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:34:38.809203 tst mo_mt_call.py: using LAC 33978 12:34:38.929065 tst mo_mt_call.py: using RAC 63 12:34:39.050047 tst mo_mt_call.py: using CellId 33978 12:34:39.170274 tst mo_mt_call.py: using BVCI 33979 12:34:39.281890 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:39.293325 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:39.304463 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:39.315690 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:39.326870 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:39.338050 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:34:39.453211 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:34:39.572856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:40.076019 run create_hlr_db(pid=21268): Launched 12:34:40.199767 bus /sierra_2: Setting Powered False 12:34:41.263762 run create_hlr_db(pid=21268): Terminated: ok {rc=0} 12:34:41.698850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21270): Launched 12:34:42.003824 run osmo-hlr_10.42.42.2(pid=21271): Launched 12:34:42.119769 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:42.645685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21273): Launched 12:34:42.948003 run osmo-stp_10.42.42.5(pid=21274): Launched 12:34:43.063242 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:43.614607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21276): Launched 12:34:43.919523 run osmo-msc_10.42.42.6(pid=21277): Launched 12:34:44.089772 run osmo-stp_10.42.42.5(pid=21274): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21274)] 12:34:44.218224 run osmo-stp_10.42.42.5(pid=21274): stdout: | (launched: 2022-12-13_12:34:42.892119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:44.346469 run osmo-stp_10.42.42.5(pid=21274): stderr: | 20221213123443063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123443063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123443064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123443064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123443065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123443065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123443065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:44.473177 run osmo-stp_10.42.42.5(pid=21274): stdout: | (launched: 2022-12-13_12:34:42.892119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:44.594063 run osmo-stp_10.42.42.5(pid=21274): stderr: | 20221213123443063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123443063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123443064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123443064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123443065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123443065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123443065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:44.739717 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21274): Process ended prematurely: osmo-stp_10.42.42.5(pid=21274) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21274)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:34:44.748870 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:34:44.775495 run osmo-hlr_10.42.42.2(pid=21271): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21271)] 12:34:44.823094 run osmo-hlr_10.42.42.2(pid=21271): stdout: | (launched: 2022-12-13_12:34:41.948099) 12:34:44.872362 run osmo-hlr_10.42.42.2(pid=21271): stderr: | 20221213123442123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123442123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123442123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123442123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123442123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123442123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123442136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123442144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123442145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123442145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:44.941130 run osmo-msc_10.42.42.6(pid=21277): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21277)] 12:34:44.988720 run osmo-msc_10.42.42.6(pid=21277): stdout: | (launched: 2022-12-13_12:34:43.863260) 12:34:45.037775 run osmo-msc_10.42.42.6(pid=21277): stderr: | 20221213123444134 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123444134 DLGLOBAL DEBUG validating counter group 0x7f3240f51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123444134 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123444134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123444135 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123444135 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123444137 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123444137 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123444137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123444137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:45.087211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21270): Terminating (SIGTERM) 12:34:45.126747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21273): Terminating (SIGTERM) 12:34:45.166148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21276): Terminating (SIGTERM) 12:34:45.205710 --- ParallelTerminationStrategy: PID 21270 died... 12:34:45.224895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21270): Terminated: ok {rc=0} 12:34:45.268737 --- ParallelTerminationStrategy: PID 21273 died... 12:34:45.287389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21273): Terminated: ok {rc=0} 12:34:45.331575 --- ParallelTerminationStrategy: PID 21276 died... 12:34:45.350340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21276): Terminated: ok {rc=0} 12:34:45.436061 bus /sierra_3: Setting Powered False 12:34:46.539419 bus /sierra_3: Setting Powered False 12:34:47.665546 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:34:48.811154 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:48.822952 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:34:48.886398 tst mo_mt_call_osmux.py: using LAC 33979 12:34:49.005644 tst mo_mt_call_osmux.py: using RAC 64 12:34:49.134439 tst mo_mt_call_osmux.py: using CellId 33979 12:34:49.264892 tst mo_mt_call_osmux.py: using BVCI 33980 12:34:49.386392 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:49.398369 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:49.410076 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:49.421572 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:49.433487 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:34:49.445248 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:34:49.563902 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:34:49.679723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:50.151531 run create_hlr_db(pid=21279): Launched 12:34:50.276222 bus /sierra_2: Setting Powered False 12:34:51.337483 run create_hlr_db(pid=21279): Terminated: ok {rc=0} 12:34:51.782536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21281): Launched 12:34:52.108170 run osmo-hlr_10.42.42.2(pid=21282): Launched 12:34:52.234247 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:52.792447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21284): Launched 12:34:53.119111 run osmo-stp_10.42.42.5(pid=21285): Launched 12:34:53.243345 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:53.833707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21287): Launched 12:34:54.160412 run osmo-msc_10.42.42.6(pid=21288): Launched 12:34:54.344061 run osmo-stp_10.42.42.5(pid=21285): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21285)] 12:34:54.481238 run osmo-stp_10.42.42.5(pid=21285): stdout: | (launched: 2022-12-13_12:34:53.058958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:54.619057 run osmo-stp_10.42.42.5(pid=21285): stderr: | 20221213123453251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123453251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123453251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123453252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123453252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123453252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123453252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:54.756083 run osmo-stp_10.42.42.5(pid=21285): stdout: | (launched: 2022-12-13_12:34:53.058958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:54.885133 run osmo-stp_10.42.42.5(pid=21285): stderr: | 20221213123453251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123453251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123453251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123453252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123453252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123453252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123453252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:55.040106 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21285): Process ended prematurely: osmo-stp_10.42.42.5(pid=21285) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21285)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:34:55.049965 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:34:55.077742 run osmo-hlr_10.42.42.2(pid=21282): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21282)] 12:34:55.128310 run osmo-hlr_10.42.42.2(pid=21282): stdout: | (launched: 2022-12-13_12:34:52.048497) 12:34:55.180169 run osmo-hlr_10.42.42.2(pid=21282): stderr: | 20221213123452248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123452248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123452249 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123452249 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123452249 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123452249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123452260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123452269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123452269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123452269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:55.252575 run osmo-msc_10.42.42.6(pid=21288): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21288)] 12:34:55.302315 run osmo-msc_10.42.42.6(pid=21288): stdout: | (launched: 2022-12-13_12:34:54.100472) 12:34:55.354076 run osmo-msc_10.42.42.6(pid=21288): stderr: | 20221213123454422 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123454423 DLGLOBAL DEBUG validating counter group 0x7f119eb51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123454423 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123454423 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123454423 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123454423 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123454425 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123454425 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123454425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123454426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:55.406243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21281): Terminating (SIGTERM) 12:34:55.448515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21284): Terminating (SIGTERM) 12:34:55.490319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21287): Terminating (SIGTERM) 12:34:55.532714 --- ParallelTerminationStrategy: PID 21281 died... 12:34:55.552872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21281): Terminated: ok {rc=0} 12:34:55.599076 --- ParallelTerminationStrategy: PID 21284 died... 12:34:55.618870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21284): Terminated: ok {rc=0} 12:34:55.665107 --- ParallelTerminationStrategy: PID 21287 died... 12:34:55.684893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21287): Terminated: ok {rc=0} 12:34:55.774096 bus /sierra_3: Setting Powered False 12:34:56.871347 bus /sierra_3: Setting Powered False 12:34:57.988557 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:34:59.231897 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:59.239462 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:34:59.263154 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:34:59.289835 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:34:59.342432 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:34:59.366993 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:34:59.395274 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:34:59.944214 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:34:59.993689 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:00.004739 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:35:00.063285 tst mo_mt_call.py: using LAC 33980 12:35:00.183172 tst mo_mt_call.py: using RAC 65 12:35:00.303964 tst mo_mt_call.py: using CellId 33980 12:35:00.433537 tst mo_mt_call.py: using BVCI 33981 12:35:00.544570 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:00.555914 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:00.567002 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:00.578129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:00.589828 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:00.601595 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:35:00.720266 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:35:00.843725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:01.389841 run create_hlr_db(pid=21293): Launched 12:35:01.584817 bus /sierra_2: Setting Powered False 12:35:02.645201 run create_hlr_db(pid=21293): Terminated: ok {rc=0} 12:35:03.107617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21298): Launched 12:35:03.436084 run osmo-hlr_10.42.42.2(pid=21299): Launched 12:35:03.561544 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:04.126860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21301): Launched 12:35:04.455013 run osmo-stp_10.42.42.5(pid=21302): Launched 12:35:04.581485 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:05.172018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21304): Launched 12:35:05.479062 run osmo-msc_10.42.42.6(pid=21305): Launched 12:35:05.650348 run osmo-stp_10.42.42.5(pid=21302): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21302)] 12:35:05.779512 run osmo-stp_10.42.42.5(pid=21302): stdout: | (launched: 2022-12-13_12:35:04.395415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:05.908289 run osmo-stp_10.42.42.5(pid=21302): stderr: | 20221213123504588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123504588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123504588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123504589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123504589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123504589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123504589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:06.034919 run osmo-stp_10.42.42.5(pid=21302): stdout: | (launched: 2022-12-13_12:35:04.395415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:06.155684 run osmo-stp_10.42.42.5(pid=21302): stderr: | 20221213123504588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123504588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123504588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123504589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123504589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123504589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123504589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:06.300606 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21302): Process ended prematurely: osmo-stp_10.42.42.5(pid=21302) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21302)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:35:06.309840 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:35:06.336275 run osmo-hlr_10.42.42.2(pid=21299): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21299)] 12:35:06.383523 run osmo-hlr_10.42.42.2(pid=21299): stdout: | (launched: 2022-12-13_12:35:03.376448) 12:35:06.432729 run osmo-hlr_10.42.42.2(pid=21299): stderr: | 20221213123503575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123503575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123503575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123503575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123503575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123503575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123503588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123503596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123503596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123503596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:06.501329 run osmo-msc_10.42.42.6(pid=21305): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21305)] 12:35:06.548546 run osmo-msc_10.42.42.6(pid=21305): stdout: | (launched: 2022-12-13_12:35:05.422301) 12:35:06.597537 run osmo-msc_10.42.42.6(pid=21305): stderr: | 20221213123505697 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123505697 DLGLOBAL DEBUG validating counter group 0x7f13fec59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123505697 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123505697 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123505697 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123505698 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123505699 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123505700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123505700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123505700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:06.646936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21298): Terminating (SIGTERM) 12:35:06.686585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21301): Terminating (SIGTERM) 12:35:06.726076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21304): Terminating (SIGTERM) 12:35:06.765996 --- ParallelTerminationStrategy: PID 21298 died... 12:35:06.785441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21298): Terminated: ok {rc=0} 12:35:06.829569 --- ParallelTerminationStrategy: PID 21301 died... 12:35:06.848121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21301): Terminated: ok {rc=0} 12:35:06.891899 --- ParallelTerminationStrategy: PID 21304 died... 12:35:06.910454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21304): Terminated: ok {rc=0} 12:35:06.994013 bus /sierra_3: Setting Powered False 12:35:08.092308 bus /sierra_3: Setting Powered False 12:35:09.212038 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:35:10.363461 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:10.375826 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:35:10.440327 tst mo_mt_call_osmux.py: using LAC 33981 12:35:10.571972 tst mo_mt_call_osmux.py: using RAC 66 12:35:10.691424 tst mo_mt_call_osmux.py: using CellId 33981 12:35:10.808703 tst mo_mt_call_osmux.py: using BVCI 33982 12:35:10.918988 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:10.930245 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:10.941414 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:10.952614 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:10.963754 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:35:10.974770 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:35:11.094172 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:35:11.213243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:11.684635 run create_hlr_db(pid=21307): Launched 12:35:11.808696 bus /sierra_2: Setting Powered False 12:35:12.873687 run create_hlr_db(pid=21307): Terminated: ok {rc=0} 12:35:13.327934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21309): Launched 12:35:13.656774 run osmo-hlr_10.42.42.2(pid=21310): Launched 12:35:13.783301 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:14.342756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21312): Launched 12:35:14.671116 run osmo-stp_10.42.42.5(pid=21313): Launched 12:35:14.796169 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:15.386347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21315): Launched 12:35:15.713643 run osmo-msc_10.42.42.6(pid=21316): Launched 12:35:15.971534 run osmo-stp_10.42.42.5(pid=21313): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21313)] 12:35:16.462397 run osmo-stp_10.42.42.5(pid=21313): stdout: | (launched: 2022-12-13_12:35:14.610955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:16.627513 run osmo-stp_10.42.42.5(pid=21313): stderr: | 20221213123514803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123514803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123514803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123514804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123514804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123514804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123514804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:16.766484 run osmo-stp_10.42.42.5(pid=21313): stdout: | (launched: 2022-12-13_12:35:14.610955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:16.899083 run osmo-stp_10.42.42.5(pid=21313): stderr: | 20221213123514803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123514803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123514803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123514804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123514804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123514804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123514804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:17.057820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21313): Process ended prematurely: osmo-stp_10.42.42.5(pid=21313) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21313)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:35:17.068521 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 12:35:17.097684 run osmo-hlr_10.42.42.2(pid=21310): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21310)] 12:35:17.151187 run osmo-hlr_10.42.42.2(pid=21310): stdout: | (launched: 2022-12-13_12:35:13.596891) 12:35:17.204916 run osmo-hlr_10.42.42.2(pid=21310): stderr: | 20221213123513797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123513797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123513797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123513797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123513797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123513797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123513833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123513843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123513843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123513843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:17.279383 run osmo-msc_10.42.42.6(pid=21316): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21316)] 12:35:17.331806 run osmo-msc_10.42.42.6(pid=21316): stdout: | (launched: 2022-12-13_12:35:15.653751) 12:35:17.383867 run osmo-msc_10.42.42.6(pid=21316): stderr: | 20221213123516096 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123516096 DLGLOBAL DEBUG validating counter group 0x7f650dd0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123516096 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123516096 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123516096 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123516096 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123516098 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123516100 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123516100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123516100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:17.436325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21309): Terminating (SIGTERM) 12:35:17.478421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21312): Terminating (SIGTERM) 12:35:17.520205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21315): Terminating (SIGTERM) 12:35:17.562808 --- ParallelTerminationStrategy: PID 21309 died... 12:35:17.583203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21309): Terminated: ok {rc=0} 12:35:17.629953 --- ParallelTerminationStrategy: PID 21312 died... 12:35:17.649955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21312): Terminated: ok {rc=0} 12:35:17.696326 --- ParallelTerminationStrategy: PID 21315 died... 12:35:17.716284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21315): Terminated: ok {rc=0} 12:35:17.805295 bus /sierra_3: Setting Powered False 12:35:18.903347 bus /sierra_3: Setting Powered False 12:35:20.021393 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:35:21.261545 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:21.269230 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:35:21.293337 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:35:21.320547 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:35:21.377420 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:35:21.402984 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:35:21.430952 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:35:21.975763 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:35:22.024518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:22.035735 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:35:22.093362 tst mo_mt_call.py: using LAC 33982 12:35:22.211548 tst mo_mt_call.py: using RAC 67 12:35:22.331374 tst mo_mt_call.py: using CellId 33982 12:35:22.450416 tst mo_mt_call.py: using BVCI 33983 12:35:22.561874 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:22.573150 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:22.584543 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:22.595593 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:22.606783 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:22.618489 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:35:22.739808 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:35:22.857202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:23.327159 run create_hlr_db(pid=21321): Launched 12:35:23.454590 bus /sierra_2: Setting Powered False 12:35:24.515209 run create_hlr_db(pid=21321): Terminated: ok {rc=0} 12:35:24.958645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21323): Launched 12:35:25.285631 run osmo-hlr_10.42.42.2(pid=21324): Launched 12:35:25.413177 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:25.978965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21326): Launched 12:35:26.305105 run osmo-stp_10.42.42.5(pid=21327): Launched 12:35:26.431619 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:27.018657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21329): Launched 12:35:27.345129 run osmo-msc_10.42.42.6(pid=21330): Launched 12:35:27.527607 run osmo-stp_10.42.42.5(pid=21327): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21327)] 12:35:27.665715 run osmo-stp_10.42.42.5(pid=21327): stdout: | (launched: 2022-12-13_12:35:26.245118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:27.803827 run osmo-stp_10.42.42.5(pid=21327): stderr: | 20221213123526439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123526439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123526439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123526439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123526440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123526440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123526440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:27.941269 run osmo-stp_10.42.42.5(pid=21327): stdout: | (launched: 2022-12-13_12:35:26.245118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:28.070620 run osmo-stp_10.42.42.5(pid=21327): stderr: | 20221213123526439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123526439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123526439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123526439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123526440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123526440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123526440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:28.225838 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21327): Process ended prematurely: osmo-stp_10.42.42.5(pid=21327) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21327)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:35:28.235445 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:35:28.263242 run osmo-hlr_10.42.42.2(pid=21324): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21324)] 12:35:28.313508 run osmo-hlr_10.42.42.2(pid=21324): stdout: | (launched: 2022-12-13_12:35:25.226023) 12:35:28.365851 run osmo-hlr_10.42.42.2(pid=21324): stderr: | 20221213123525426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123525426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123525426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123525426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123525426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123525426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123525439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123525448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123525448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123525448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:28.438183 run osmo-msc_10.42.42.6(pid=21330): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21330)] 12:35:28.487691 run osmo-msc_10.42.42.6(pid=21330): stdout: | (launched: 2022-12-13_12:35:27.284675) 12:35:28.539308 run osmo-msc_10.42.42.6(pid=21330): stderr: | 20221213123527608 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123527608 DLGLOBAL DEBUG validating counter group 0x7f32a107cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123527608 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123527608 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123527608 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123527608 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123527610 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123527611 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123527611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123527611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:28.591422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21323): Terminating (SIGTERM) 12:35:28.633194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21326): Terminating (SIGTERM) 12:35:28.674878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21329): Terminating (SIGTERM) 12:35:28.716829 --- ParallelTerminationStrategy: PID 21323 died... 12:35:28.737128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21323): Terminated: ok {rc=0} 12:35:28.783194 --- ParallelTerminationStrategy: PID 21326 died... 12:35:28.802918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21326): Terminated: ok {rc=0} 12:35:28.848843 --- ParallelTerminationStrategy: PID 21329 died... 12:35:28.869257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21329): Terminated: ok {rc=0} 12:35:28.957502 bus /sierra_3: Setting Powered False 12:35:30.054975 bus /sierra_3: Setting Powered False 12:35:31.170371 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:35:32.315623 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:32.327609 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:35:32.387652 tst mo_mt_call_osmux.py: using LAC 33983 12:35:32.506808 tst mo_mt_call_osmux.py: using RAC 68 12:35:32.627458 tst mo_mt_call_osmux.py: using CellId 33983 12:35:32.748331 tst mo_mt_call_osmux.py: using BVCI 33984 12:35:32.860603 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:32.871941 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:32.882981 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:32.894120 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:32.905280 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:35:32.916326 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:35:33.030218 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:35:33.147618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:33.617656 run create_hlr_db(pid=21332): Launched 12:35:33.743494 bus /sierra_2: Setting Powered False 12:35:34.804069 run create_hlr_db(pid=21332): Terminated: ok {rc=0} 12:35:35.227125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21334): Launched 12:35:35.531167 run osmo-hlr_10.42.42.2(pid=21335): Launched 12:35:35.646874 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:36.186182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21337): Launched 12:35:36.491230 run osmo-stp_10.42.42.5(pid=21338): Launched 12:35:36.607117 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:37.163173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21340): Launched 12:35:37.468731 run osmo-msc_10.42.42.6(pid=21341): Launched 12:35:37.639980 run osmo-stp_10.42.42.5(pid=21338): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21338)] 12:35:37.768667 run osmo-stp_10.42.42.5(pid=21338): stdout: | (launched: 2022-12-13_12:35:36.434352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:37.897134 run osmo-stp_10.42.42.5(pid=21338): stderr: | 20221213123536607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123536607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123536607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123536608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123536608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123536608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123536608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:38.023613 run osmo-stp_10.42.42.5(pid=21338): stdout: | (launched: 2022-12-13_12:35:36.434352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:38.144105 run osmo-stp_10.42.42.5(pid=21338): stderr: | 20221213123536607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123536607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123536607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123536608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123536608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123536608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123536608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:38.288668 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21338): Process ended prematurely: osmo-stp_10.42.42.5(pid=21338) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21338)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:35:38.297964 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:35:38.324569 run osmo-hlr_10.42.42.2(pid=21335): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21335)] 12:35:38.371802 run osmo-hlr_10.42.42.2(pid=21335): stdout: | (launched: 2022-12-13_12:35:35.475039) 12:35:38.420702 run osmo-hlr_10.42.42.2(pid=21335): stderr: | 20221213123535652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123535652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123535652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123535653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123535653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123535653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123535665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123535675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123535675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123535675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:38.488832 run osmo-msc_10.42.42.6(pid=21341): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21341)] 12:35:38.535885 run osmo-msc_10.42.42.6(pid=21341): stdout: | (launched: 2022-12-13_12:35:37.412405) 12:35:38.584570 run osmo-msc_10.42.42.6(pid=21341): stderr: | 20221213123537684 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123537684 DLGLOBAL DEBUG validating counter group 0x7f45c21b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123537684 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123537684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123537684 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123537685 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123537686 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123537687 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123537687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123537687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:38.633599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21334): Terminating (SIGTERM) 12:35:38.672870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21337): Terminating (SIGTERM) 12:35:38.712123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21340): Terminating (SIGTERM) 12:35:38.751629 --- ParallelTerminationStrategy: PID 21334 died... 12:35:38.770892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21334): Terminated: ok {rc=0} 12:35:38.814542 --- ParallelTerminationStrategy: PID 21337 died... 12:35:38.833289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21337): Terminated: ok {rc=0} 12:35:38.876672 --- ParallelTerminationStrategy: PID 21340 died... 12:35:38.895274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21340): Terminated: ok {rc=0} 12:35:38.980368 bus /sierra_3: Setting Powered False 12:35:40.078242 bus /sierra_3: Setting Powered False 12:35:41.192401 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:35:42.433094 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:42.440058 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:35:42.463770 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:35:42.490436 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:35:42.540526 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:35:42.564559 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:35:42.591347 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:35:43.144163 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:35:43.193263 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:43.204373 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:35:43.263406 tst mo_mt_call.py: using LAC 33984 12:35:43.381068 tst mo_mt_call.py: using RAC 69 12:35:43.498126 tst mo_mt_call.py: using CellId 33984 12:35:43.617524 tst mo_mt_call.py: using BVCI 33985 12:35:43.729069 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:43.740264 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:43.751254 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:43.762416 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:43.773562 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:43.784912 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:35:43.904555 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:35:44.021354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:44.523811 run create_hlr_db(pid=21346): Launched 12:35:44.648429 bus /sierra_2: Setting Powered False 12:35:45.712677 run create_hlr_db(pid=21346): Terminated: ok {rc=0} 12:35:46.162192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21348): Launched 12:35:46.564822 run osmo-hlr_10.42.42.2(pid=21349): Launched 12:35:46.820386 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:47.497989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21351): Launched 12:35:47.826343 run osmo-stp_10.42.42.5(pid=21352): Launched 12:35:47.953132 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:48.542216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21354): Launched 12:35:48.868651 run osmo-msc_10.42.42.6(pid=21355): Launched 12:35:49.049787 run osmo-stp_10.42.42.5(pid=21352): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21352)] 12:35:49.186589 run osmo-stp_10.42.42.5(pid=21352): stdout: | (launched: 2022-12-13_12:35:47.766814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:49.323964 run osmo-stp_10.42.42.5(pid=21352): stderr: | 20221213123547957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123547958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123547958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123547958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123547959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123547959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123547959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:49.460757 run osmo-stp_10.42.42.5(pid=21352): stdout: | (launched: 2022-12-13_12:35:47.766814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:49.589996 run osmo-stp_10.42.42.5(pid=21352): stderr: | 20221213123547957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123547958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123547958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123547958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123547959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123547959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123547959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:49.744372 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21352): Process ended prematurely: osmo-stp_10.42.42.5(pid=21352) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21352)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:35:49.754039 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:35:49.781712 run osmo-hlr_10.42.42.2(pid=21349): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21349)] 12:35:49.831911 run osmo-hlr_10.42.42.2(pid=21349): stdout: | (launched: 2022-12-13_12:35:46.506191) 12:35:49.883998 run osmo-hlr_10.42.42.2(pid=21349): stderr: | 20221213123546734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123546734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123546734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123546734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123546734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123546734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123546745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123546760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123546760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123546760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:49.956708 run osmo-msc_10.42.42.6(pid=21355): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21355)] 12:35:50.006425 run osmo-msc_10.42.42.6(pid=21355): stdout: | (launched: 2022-12-13_12:35:48.808572) 12:35:50.058120 run osmo-msc_10.42.42.6(pid=21355): stderr: | 20221213123549131 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123549131 DLGLOBAL DEBUG validating counter group 0x7f1d4b64ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123549131 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123549131 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123549132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123549132 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123549133 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123549134 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123549134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123549134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:50.110416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21348): Terminating (SIGTERM) 12:35:50.151911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21351): Terminating (SIGTERM) 12:35:50.193406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21354): Terminating (SIGTERM) 12:35:50.235433 --- ParallelTerminationStrategy: PID 21348 died... 12:35:50.255753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21348): Terminated: ok {rc=0} 12:35:50.302058 --- ParallelTerminationStrategy: PID 21351 died... 12:35:50.321952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21351): Terminated: ok {rc=0} 12:35:50.368268 --- ParallelTerminationStrategy: PID 21354 died... 12:35:50.388178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21354): Terminated: ok {rc=0} 12:35:50.475666 bus /sierra_3: Setting Powered False 12:35:51.573368 bus /sierra_3: Setting Powered False 12:35:52.688494 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:35:53.837724 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:53.850213 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:35:53.912292 tst mo_mt_call_osmux.py: using LAC 33985 12:35:54.046352 tst mo_mt_call_osmux.py: using RAC 70 12:35:54.174083 tst mo_mt_call_osmux.py: using CellId 33985 12:35:54.304829 tst mo_mt_call_osmux.py: using BVCI 33986 12:35:54.423698 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:54.435396 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:54.447054 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:54.458602 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:54.470587 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:35:54.482538 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:35:54.598952 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:35:54.718841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:55.224466 run create_hlr_db(pid=21357): Launched 12:35:55.350201 bus /sierra_2: Setting Powered False 12:35:56.415622 run create_hlr_db(pid=21357): Terminated: ok {rc=0} 12:35:56.851021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21359): Launched 12:35:57.156035 run osmo-hlr_10.42.42.2(pid=21360): Launched 12:35:57.272171 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:57.799699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21362): Launched 12:35:58.105398 run osmo-stp_10.42.42.5(pid=21363): Launched 12:35:58.222168 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:58.774648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21365): Launched 12:35:59.080850 run osmo-msc_10.42.42.6(pid=21366): Launched 12:35:59.251027 run osmo-stp_10.42.42.5(pid=21363): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21363)] 12:35:59.379104 run osmo-stp_10.42.42.5(pid=21363): stdout: | (launched: 2022-12-13_12:35:58.048837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:59.507535 run osmo-stp_10.42.42.5(pid=21363): stderr: | 20221213123558219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123558220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123558220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123558220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123558221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123558221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123558221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:59.633678 run osmo-stp_10.42.42.5(pid=21363): stdout: | (launched: 2022-12-13_12:35:58.048837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:59.754149 run osmo-stp_10.42.42.5(pid=21363): stderr: | 20221213123558219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123558220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123558220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123558220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123558221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123558221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123558221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:59.898606 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21363): Process ended prematurely: osmo-stp_10.42.42.5(pid=21363) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21363)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:35:59.907689 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:35:59.934799 run osmo-hlr_10.42.42.2(pid=21360): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21360)] 12:35:59.982487 run osmo-hlr_10.42.42.2(pid=21360): stdout: | (launched: 2022-12-13_12:35:57.100012) 12:36:00.031716 run osmo-hlr_10.42.42.2(pid=21360): stderr: | 20221213123557279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123557279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123557279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123557279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123557279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123557279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123557290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123557299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123557299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123557299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:00.100794 run osmo-msc_10.42.42.6(pid=21366): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21366)] 12:36:00.148448 run osmo-msc_10.42.42.6(pid=21366): stdout: | (launched: 2022-12-13_12:35:59.024515) 12:36:00.197772 run osmo-msc_10.42.42.6(pid=21366): stderr: | 20221213123559298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123559298 DLGLOBAL DEBUG validating counter group 0x7fda0d65bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123559298 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123559298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123559298 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123559299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123559300 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123559301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123559301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123559301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:00.247180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21359): Terminating (SIGTERM) 12:36:00.286698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21362): Terminating (SIGTERM) 12:36:00.326116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21365): Terminating (SIGTERM) 12:36:00.365812 --- ParallelTerminationStrategy: PID 21359 died... 12:36:00.384862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21359): Terminated: ok {rc=0} 12:36:00.429160 --- ParallelTerminationStrategy: PID 21362 died... 12:36:00.447797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21362): Terminated: ok {rc=0} 12:36:00.491404 --- ParallelTerminationStrategy: PID 21365 died... 12:36:00.509999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21365): Terminated: ok {rc=0} 12:36:00.595351 bus /sierra_3: Setting Powered False 12:36:01.704410 bus /sierra_3: Setting Powered False 12:36:02.836464 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:36:04.077690 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:04.084817 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:36:04.108552 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:36:04.135419 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:36:04.189052 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:36:04.214475 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:36:04.242296 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:36:04.794197 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:36:04.846596 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:04.858374 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:36:04.920556 tst mo_mt_call.py: using LAC 33986 12:36:05.047334 tst mo_mt_call.py: using RAC 71 12:36:05.174011 tst mo_mt_call.py: using CellId 33986 12:36:05.300621 tst mo_mt_call.py: using BVCI 33987 12:36:05.420786 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:05.432526 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:05.444121 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:05.455637 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:05.467605 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:05.479413 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:36:05.601985 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:36:05.717902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:06.188600 run create_hlr_db(pid=21371): Launched 12:36:06.312623 bus /sierra_2: Setting Powered False 12:36:07.373954 run create_hlr_db(pid=21371): Terminated: ok {rc=0} 12:36:07.818251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21373): Launched 12:36:08.145107 run osmo-hlr_10.42.42.2(pid=21374): Launched 12:36:08.270744 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:08.829789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21376): Launched 12:36:09.156119 run osmo-stp_10.42.42.5(pid=21377): Launched 12:36:09.282585 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:09.874785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21379): Launched 12:36:10.201454 run osmo-msc_10.42.42.6(pid=21380): Launched 12:36:10.386840 run osmo-stp_10.42.42.5(pid=21377): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21377)] 12:36:10.524518 run osmo-stp_10.42.42.5(pid=21377): stdout: | (launched: 2022-12-13_12:36:09.096031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:10.663045 run osmo-stp_10.42.42.5(pid=21377): stderr: | 20221213123609289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123609289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123609289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123609290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123609290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123609290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123609290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:10.800523 run osmo-stp_10.42.42.5(pid=21377): stdout: | (launched: 2022-12-13_12:36:09.096031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:10.930429 run osmo-stp_10.42.42.5(pid=21377): stderr: | 20221213123609289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123609289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123609289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123609290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123609290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123609290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123609290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:11.086021 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21377): Process ended prematurely: osmo-stp_10.42.42.5(pid=21377) [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21377)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:36:11.095830 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:36:11.123828 run osmo-hlr_10.42.42.2(pid=21374): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21374)] 12:36:11.174297 run osmo-hlr_10.42.42.2(pid=21374): stdout: | (launched: 2022-12-13_12:36:08.085585) 12:36:11.226300 run osmo-hlr_10.42.42.2(pid=21374): stderr: | 20221213123608286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123608286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123608286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123608286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123608286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123608286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123608299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123608307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123608307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123608307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:11.298960 run osmo-msc_10.42.42.6(pid=21380): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21380)] 12:36:11.349174 run osmo-msc_10.42.42.6(pid=21380): stdout: | (launched: 2022-12-13_12:36:10.141671) 12:36:11.401104 run osmo-msc_10.42.42.6(pid=21380): stderr: | 20221213123610464 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123610464 DLGLOBAL DEBUG validating counter group 0x7fa00331fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123610464 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123610464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123610464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123610464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123610466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123610466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123610467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123610467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:11.453524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21373): Terminating (SIGTERM) 12:36:11.494959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21376): Terminating (SIGTERM) 12:36:11.536819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21379): Terminating (SIGTERM) 12:36:11.579276 --- ParallelTerminationStrategy: PID 21373 died... 12:36:11.599544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21373): Terminated: ok {rc=0} 12:36:11.645996 --- ParallelTerminationStrategy: PID 21376 died... 12:36:11.665954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21376): Terminated: ok {rc=0} 12:36:11.713831 --- ParallelTerminationStrategy: PID 21379 died... 12:36:11.733458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21379): Terminated: ok {rc=0} 12:36:11.820009 bus /sierra_3: Setting Powered False 12:36:12.919776 bus /sierra_3: Setting Powered False 12:36:14.033722 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:36:15.178347 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:15.190337 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:36:15.251841 tst mo_mt_call_osmux.py: using LAC 33987 12:36:15.371461 tst mo_mt_call_osmux.py: using RAC 72 12:36:15.492514 tst mo_mt_call_osmux.py: using CellId 33987 12:36:15.612398 tst mo_mt_call_osmux.py: using BVCI 33988 12:36:15.724108 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:15.735490 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:15.746582 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:15.757659 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:15.768800 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:36:15.779850 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:36:15.924847 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:36:16.043218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:16.564475 run create_hlr_db(pid=21382): Launched 12:36:16.716205 bus /sierra_2: Setting Powered False 12:36:17.781573 run create_hlr_db(pid=21382): Terminated: ok {rc=0} 12:36:18.219408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21384): Launched 12:36:18.525729 run osmo-hlr_10.42.42.2(pid=21385): Launched 12:36:18.642730 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:19.174229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21387): Launched 12:36:19.479653 run osmo-stp_10.42.42.5(pid=21388): Launched 12:36:19.596068 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:20.146801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21390): Launched 12:36:20.454024 run osmo-msc_10.42.42.6(pid=21391): Launched 12:36:20.624150 run osmo-stp_10.42.42.5(pid=21388): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21388)] 12:36:20.752265 run osmo-stp_10.42.42.5(pid=21388): stdout: | (launched: 2022-12-13_12:36:19.423332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:20.880221 run osmo-stp_10.42.42.5(pid=21388): stderr: | 20221213123619596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123619596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123619597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123619597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123619597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123619598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123619598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:21.006642 run osmo-stp_10.42.42.5(pid=21388): stdout: | (launched: 2022-12-13_12:36:19.423332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:21.127362 run osmo-stp_10.42.42.5(pid=21388): stderr: | 20221213123619596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123619596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123619597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123619597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123619597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123619598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123619598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:21.271971 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21388): Process ended prematurely: osmo-stp_10.42.42.5(pid=21388) [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21388)] [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:36:21.281055 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:36:21.307741 run osmo-hlr_10.42.42.2(pid=21385): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21385)] 12:36:21.355230 run osmo-hlr_10.42.42.2(pid=21385): stdout: | (launched: 2022-12-13_12:36:18.469451) 12:36:21.404350 run osmo-hlr_10.42.42.2(pid=21385): stderr: | 20221213123618647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123618647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123618647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123618647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123618647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123618647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123618659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123618668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123618669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123618669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:21.473028 run osmo-msc_10.42.42.6(pid=21391): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21391)] 12:36:21.520189 run osmo-msc_10.42.42.6(pid=21391): stdout: | (launched: 2022-12-13_12:36:20.396673) 12:36:21.569104 run osmo-msc_10.42.42.6(pid=21391): stderr: | 20221213123620669 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123620669 DLGLOBAL DEBUG validating counter group 0x7fe70a15ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123620670 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123620670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123620670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123620670 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123620672 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123620672 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123620672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123620672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:21.619015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21384): Terminating (SIGTERM) 12:36:21.658432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21387): Terminating (SIGTERM) 12:36:21.697876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21390): Terminating (SIGTERM) 12:36:21.737543 --- ParallelTerminationStrategy: PID 21384 died... 12:36:21.756381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21384): Terminated: ok {rc=0} 12:36:21.800177 --- ParallelTerminationStrategy: PID 21387 died... 12:36:21.818920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21387): Terminated: ok {rc=0} 12:36:21.862396 --- ParallelTerminationStrategy: PID 21390 died... 12:36:21.881085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21390): Terminated: ok {rc=0} 12:36:21.967568 bus /sierra_3: Setting Powered False 12:36:23.066921 bus /sierra_3: Setting Powered False 12:36:24.181806 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 emergency:nanobts+band-1900 --------------------------------------------------------------------- 12:36:25.422286 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:25.427776 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:36:25.451479 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:36:25.478065 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 12:36:25.563311 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:36:25.588764 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:36:25.616904 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 12:36:26.202647 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2389 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 12:36:26.208038 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:26.219487 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:36:26.260426 tst emergency_mo_mt_call.py: using LAC 33988 12:36:26.388831 tst emergency_mo_mt_call.py: using RAC 73 12:36:26.516258 tst emergency_mo_mt_call.py: using CellId 33988 12:36:26.646938 tst emergency_mo_mt_call.py: using BVCI 33989 12:36:26.765655 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:26.777073 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:26.788404 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:26.799475 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:26.811048 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:26.822668 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:36:26.937796 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:36:27.056330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:27.550756 run create_hlr_db(pid=21396): Launched 12:36:27.673808 bus /sierra_2: Setting Powered False 12:36:28.737459 run create_hlr_db(pid=21396): Terminated: ok {rc=0} 12:36:29.164364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21398): Launched 12:36:29.462655 run osmo-hlr_10.42.42.2(pid=21399): Launched 12:36:29.577056 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:30.090360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21401): Launched 12:36:30.389650 run osmo-stp_10.42.42.5(pid=21402): Launched 12:36:30.513813 tst emergency_mo_mt_call.py: using MSISDN 8154 12:36:30.667100 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:31.271252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21404): Launched 12:36:31.611709 run osmo-msc_10.42.42.6(pid=21405): Launched 12:36:31.814314 run osmo-stp_10.42.42.5(pid=21402): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21402)] 12:36:32.134665 run osmo-stp_10.42.42.5(pid=21402): stdout: | (launched: 2022-12-13_12:36:30.334080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:32.363122 run osmo-stp_10.42.42.5(pid=21402): stderr: | 20221213123630505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123630505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123630505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123630506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123630507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123630507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123630507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:32.498013 run osmo-stp_10.42.42.5(pid=21402): stdout: | (launched: 2022-12-13_12:36:30.334080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:32.625874 run osmo-stp_10.42.42.5(pid=21402): stderr: | 20221213123630505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123630505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123630505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123630506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123630507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123630507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123630507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:32.778634 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21402): Process ended prematurely: osmo-stp_10.42.42.5(pid=21402) [trial-2389↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21402)] [trial-2389↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 12:36:32.787909 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 12:36:32.815508 run osmo-hlr_10.42.42.2(pid=21399): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21399)] 12:36:32.866225 run osmo-hlr_10.42.42.2(pid=21399): stdout: | (launched: 2022-12-13_12:36:29.407530) 12:36:32.918009 run osmo-hlr_10.42.42.2(pid=21399): stderr: | 20221213123629583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123629583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123629583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123629583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123629583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123629583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123629595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123629604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123629605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123629605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:32.990625 run osmo-msc_10.42.42.6(pid=21405): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21405)] 12:36:33.040512 run osmo-msc_10.42.42.6(pid=21405): stdout: | (launched: 2022-12-13_12:36:31.551149) 12:36:33.091995 run osmo-msc_10.42.42.6(pid=21405): stderr: | 20221213123632244 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123632244 DLGLOBAL DEBUG validating counter group 0x7f39c6704c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123632244 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123632244 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123632244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123632245 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123632249 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123632249 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123632249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123632249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:33.143657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21398): Terminating (SIGTERM) 12:36:33.185669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21401): Terminating (SIGTERM) 12:36:33.228032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21404): Terminating (SIGTERM) 12:36:33.270610 --- ParallelTerminationStrategy: PID 21398 died... 12:36:33.291311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21398): Terminated: ok {rc=0} 12:36:33.337911 --- ParallelTerminationStrategy: PID 21401 died... 12:36:33.358295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21401): Terminated: ok {rc=0} 12:36:33.404576 --- ParallelTerminationStrategy: PID 21404 died... 12:36:33.424611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21404): Terminated: ok {rc=0} 12:36:33.512822 bus /sierra_3: Setting Powered False 12:36:34.612799 bus /sierra_3: Setting Powered False 12:36:35.728478 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 12:36:36.812442 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:36.824121 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:36:36.866808 tst emergency_preemptive_call.py: using LAC 33989 12:36:36.992803 tst emergency_preemptive_call.py: using RAC 74 12:36:37.111771 tst emergency_preemptive_call.py: using CellId 33989 12:36:37.239042 tst emergency_preemptive_call.py: using BVCI 33990 12:36:37.357528 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:37.368891 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:37.380646 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:37.391957 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:37.404097 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:36:37.416263 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:36:37.534462 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:36:37.648683 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:36:37.767310 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:36:37.886108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:38.383281 run create_hlr_db(pid=21408): Launched 12:36:38.507557 bus /sierra_2: Setting Powered False 12:36:39.570544 run create_hlr_db(pid=21408): Terminated: ok {rc=0} 12:36:40.016144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21410): Launched 12:36:40.338293 run osmo-hlr_10.42.42.2(pid=21411): Launched 12:36:40.463281 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:41.014879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21413): Launched 12:36:41.336769 run osmo-stp_10.42.42.5(pid=21414): Launched 12:36:41.471601 tst emergency_preemptive_call.py: using MSISDN 8155 12:36:41.636491 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:42.211069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21416): Launched 12:36:42.534067 run osmo-msc_10.42.42.6(pid=21417): Launched 12:36:42.715361 run osmo-stp_10.42.42.5(pid=21414): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21414)] 12:36:42.850930 run osmo-stp_10.42.42.5(pid=21414): stdout: | (launched: 2022-12-13_12:36:41.277817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:42.987205 run osmo-stp_10.42.42.5(pid=21414): stderr: | 20221213123641472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123641472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123641472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123641472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123641473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123641473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123641473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:43.122620 run osmo-stp_10.42.42.5(pid=21414): stdout: | (launched: 2022-12-13_12:36:41.277817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:43.250535 run osmo-stp_10.42.42.5(pid=21414): stderr: | 20221213123641472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123641472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123641472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123641472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123641473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123641473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123641473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:43.404086 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21414): Process ended prematurely: osmo-stp_10.42.42.5(pid=21414) [trial-2389↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21414)] [trial-2389↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 12:36:43.413145 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 12:36:43.440674 run osmo-hlr_10.42.42.2(pid=21411): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21411)] 12:36:43.491277 run osmo-hlr_10.42.42.2(pid=21411): stdout: | (launched: 2022-12-13_12:36:40.279487) 12:36:43.543298 run osmo-hlr_10.42.42.2(pid=21411): stderr: | 20221213123640477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123640478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123640478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123640478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123640478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123640478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123640490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123640498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123640498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123640498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:43.616157 run osmo-msc_10.42.42.6(pid=21417): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21417)] 12:36:43.666116 run osmo-msc_10.42.42.6(pid=21417): stdout: | (launched: 2022-12-13_12:36:42.475066) 12:36:43.717920 run osmo-msc_10.42.42.6(pid=21417): stderr: | 20221213123642795 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213123642795 DLGLOBAL DEBUG validating counter group 0x7fe34012dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213123642796 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213123642796 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213123642796 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213123642796 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213123642798 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213123642798 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213123642798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213123642799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:43.770486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21410): Terminating (SIGTERM) 12:36:43.812197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21413): Terminating (SIGTERM) 12:36:43.854809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21416): Terminating (SIGTERM) 12:36:43.897057 --- ParallelTerminationStrategy: PID 21410 died... 12:36:43.917419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21410): Terminated: ok {rc=0} 12:36:43.963787 --- ParallelTerminationStrategy: PID 21413 died... 12:36:43.983640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21413): Terminated: ok {rc=0} 12:36:44.029956 --- ParallelTerminationStrategy: PID 21416 died... 12:36:44.049831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21416): Terminated: ok {rc=0} 12:36:44.138048 bus /sierra_9: Setting Powered False 12:36:45.235965 bus /sierra_9: Setting Powered False 12:36:46.354728 bus /sierra_8: Setting Powered False 12:36:47.461929 bus /sierra_8: Setting Powered False 12:36:48.574820 bus /sierra_3: Setting Powered False 12:36:49.672441 bus /sierra_3: Setting Powered False 12:36:50.787455 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-1900 --------------------------------------------------------------------- 12:36:52.060117 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:52.065152 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:36:52.088761 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 12:36:52.127582 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 12:36:52.219190 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:36:52.242972 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 12:36:52.280924 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 12:36:52.868680 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 12:36:52.918232 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:36:52.929038 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:36:52.965759 tst cs_paging_gprs_active.py: using LAC 33990 12:36:53.082863 tst cs_paging_gprs_active.py: using RAC 75 12:36:53.201773 tst cs_paging_gprs_active.py: using CellId 33990 12:36:53.319545 tst cs_paging_gprs_active.py: using BVCI 33991 12:36:53.430811 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:36:53.441643 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:36:53.452169 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:36:53.462731 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:36:53.473304 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:36:53.484159 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:36:53.495327 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:36:53.505815 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:36:53.516366 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:36:53.630216 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:36:53.745622 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:36:53.949368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:36:54.254365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21424): Launched 12:36:54.520918 run iperf3-srv_10.42.42.10(pid=21425): Launched 12:36:54.635202 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:36:54.838950 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:36:55.145270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21426): Launched 12:36:55.411367 run iperf3-srv_10.42.42.10(pid=21427): Launched 12:36:55.525625 tst cs_paging_gprs_active.py:38: start network... 12:36:55.729293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:56.201069 run create_hlr_db(pid=21428): Launched 12:36:56.325821 bus /sierra_2: Setting Powered False 12:36:57.386373 run create_hlr_db(pid=21428): Terminated: ok {rc=0} 12:36:57.811915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21430): Launched 12:36:58.117951 run osmo-hlr_10.42.42.2(pid=21431): Launched 12:36:58.234134 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:58.758385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21433): Launched 12:36:59.063894 run osmo-stp_10.42.42.5(pid=21434): Launched 12:36:59.180015 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:36:59.705670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21436): Launched 12:36:59.823439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:00.082920 run patchelf(pid=21437): Launched 12:37:00.253848 run osmo-stp_10.42.42.5(pid=21434): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21434)] 12:37:00.382963 run osmo-stp_10.42.42.5(pid=21434): stdout: | (launched: 2022-12-13_12:36:59.007434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:00.514972 run osmo-stp_10.42.42.5(pid=21434): stderr: | 20221213123659179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123659179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123659180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123659180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123659181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123659181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123659181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:00.646296 run osmo-stp_10.42.42.5(pid=21434): stdout: | (launched: 2022-12-13_12:36:59.007434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:00.770801 run osmo-stp_10.42.42.5(pid=21434): stderr: | 20221213123659179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123659179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123659180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123659180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123659181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123659181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123659181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:00.953379 run patchelf(pid=21437): Terminating (SIGINT) 12:37:01.144152 run patchelf(pid=21437): Terminated: ok {rc=0} 12:37:01.280922 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21434): Process ended prematurely: osmo-stp_10.42.42.5(pid=21434) [trial-2389↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21434)] [trial-2389↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 12:37:01.292563 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 12:37:01.323951 run osmo-hlr_10.42.42.2(pid=21431): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21431)] 12:37:01.380028 run osmo-hlr_10.42.42.2(pid=21431): stdout: | (launched: 2022-12-13_12:36:58.061152) 12:37:01.435190 run osmo-hlr_10.42.42.2(pid=21431): stderr: | 20221213123658237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123658237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123658237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123658237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123658237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123658237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123658250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123658258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123658259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123658259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:01.490300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21424): Terminating (SIGTERM) 12:37:01.534310 run iperf3-srv_10.42.42.10(pid=21425): Terminating (SIGTERM) 12:37:01.583200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21426): Terminating (SIGTERM) 12:37:01.628363 run iperf3-srv_10.42.42.10(pid=21427): Terminating (SIGTERM) 12:37:01.676578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21430): Terminating (SIGTERM) 12:37:01.723435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21433): Terminating (SIGTERM) 12:37:01.769927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21436): Terminating (SIGTERM) 12:37:01.817652 --- ParallelTerminationStrategy: PID 21424 died... 12:37:01.840118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21424): Terminated: ok {rc=0} 12:37:01.891678 --- ParallelTerminationStrategy: PID 21425 died... 12:37:01.912465 run iperf3-srv_10.42.42.10(pid=21425): Terminated {rc=256} 12:37:01.961974 --- ParallelTerminationStrategy: PID 21426 died... 12:37:01.984666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21426): Terminated: ok {rc=0} 12:37:02.033152 --- ParallelTerminationStrategy: PID 21427 died... 12:37:02.054696 run iperf3-srv_10.42.42.10(pid=21427): Terminated {rc=256} 12:37:02.103396 --- ParallelTerminationStrategy: PID 21430 died... 12:37:02.125572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21430): Terminated: ok {rc=0} 12:37:02.172567 --- ParallelTerminationStrategy: PID 21433 died... 12:37:02.193928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21433): Terminated: ok {rc=0} 12:37:02.240859 --- ParallelTerminationStrategy: PID 21436 died... 12:37:02.261263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21436): Terminated: ok {rc=0} 12:37:02.349862 bus /gobi_0: Setting Powered False 12:37:03.444034 bus /gobi_0: Setting Powered False 12:37:04.559007 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 12:37:05.705342 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:05.716588 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:37:05.755804 tst iperf3.py: using LAC 33991 12:37:05.877215 tst iperf3.py: using RAC 76 12:37:05.995540 tst iperf3.py: using CellId 33991 12:37:06.119489 tst iperf3.py: using BVCI 33992 12:37:06.240445 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:06.251954 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:06.263231 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:06.274501 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:06.286026 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:06.297311 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:06.308663 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:06.320125 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:06.331500 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:37:06.449907 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:37:06.654903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:06.959575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21438): Launched 12:37:07.224533 run iperf3-srv_10.42.42.10(pid=21439): Launched 12:37:07.338161 tst iperf3.py:8: start network... 12:37:07.542109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:08.011857 run create_hlr_db(pid=21440): Launched 12:37:08.137385 bus /gobi_6: Setting Powered False 12:37:09.202565 run create_hlr_db(pid=21440): Terminated: ok {rc=0} 12:37:09.638682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21442): Launched 12:37:09.943265 run osmo-hlr_10.42.42.2(pid=21443): Launched 12:37:10.059278 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:10.580287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21445): Launched 12:37:10.885035 run osmo-stp_10.42.42.5(pid=21446): Launched 12:37:11.000533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:11.526412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21448): Launched 12:37:11.643111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:11.900547 run patchelf(pid=21449): Launched 12:37:12.069956 run osmo-stp_10.42.42.5(pid=21446): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21446)] 12:37:12.198828 run osmo-stp_10.42.42.5(pid=21446): stdout: | (launched: 2022-12-13_12:37:10.828638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:12.328568 run osmo-stp_10.42.42.5(pid=21446): stderr: | 20221213123710998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123710998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123710998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123710999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123710999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123710999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123710999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:12.459014 run osmo-stp_10.42.42.5(pid=21446): stdout: | (launched: 2022-12-13_12:37:10.828638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:12.583857 run osmo-stp_10.42.42.5(pid=21446): stderr: | 20221213123710998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123710998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123710998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123710999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123710999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123710999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123710999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:12.730622 run patchelf(pid=21449): Terminating (SIGINT) 12:37:12.900225 run patchelf(pid=21449): Terminated: ok {rc=0} 12:37:13.023235 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21446): Process ended prematurely: osmo-stp_10.42.42.5(pid=21446) [trial-2389↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21446)] [trial-2389↪gprs:nanobts+band-1900↪iperf3.py:8] 12:37:13.032806 tst iperf3.py:8: Test FAILED (7.4 sec) 12:37:13.060128 run osmo-hlr_10.42.42.2(pid=21443): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21443)] 12:37:13.107653 run osmo-hlr_10.42.42.2(pid=21443): stdout: | (launched: 2022-12-13_12:37:09.886912) 12:37:13.157360 run osmo-hlr_10.42.42.2(pid=21443): stderr: | 20221213123710066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123710066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123710066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123710066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123710066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123710066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123710081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123710092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123710092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123710092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:13.206879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21438): Terminating (SIGTERM) 12:37:13.246206 run iperf3-srv_10.42.42.10(pid=21439): Terminating (SIGTERM) 12:37:13.285404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21442): Terminating (SIGTERM) 12:37:13.325084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21445): Terminating (SIGTERM) 12:37:13.364625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21448): Terminating (SIGTERM) 12:37:13.404311 --- ParallelTerminationStrategy: PID 21438 died... 12:37:13.423536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21438): Terminated: ok {rc=0} 12:37:13.467570 --- ParallelTerminationStrategy: PID 21439 died... 12:37:13.486171 run iperf3-srv_10.42.42.10(pid=21439): Terminated {rc=256} 12:37:13.529653 --- ParallelTerminationStrategy: PID 21442 died... 12:37:13.548260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21442): Terminated: ok {rc=0} 12:37:13.591800 --- ParallelTerminationStrategy: PID 21445 died... 12:37:13.610536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21445): Terminated: ok {rc=0} 12:37:13.654284 --- ParallelTerminationStrategy: PID 21448 died... 12:37:13.672755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21448): Terminated: ok {rc=0} 12:37:13.758725 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 12:37:14.905482 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:14.916918 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:37:14.956568 tst iperf3m4.py: using LAC 33992 12:37:15.076154 tst iperf3m4.py: using RAC 77 12:37:15.196444 tst iperf3m4.py: using CellId 33992 12:37:15.315468 tst iperf3m4.py: using BVCI 33993 12:37:15.427512 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:15.438407 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:15.449204 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:15.459831 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:15.470448 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:15.481544 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:15.492860 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:15.503508 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:15.514467 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:37:15.630912 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:37:15.752434 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:37:15.878238 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:37:16.001215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:37:16.231543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:16.568220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21450): Launched 12:37:16.871834 run iperf3-srv_10.42.42.10(pid=21451): Launched 12:37:17.043258 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:37:17.264918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:17.572182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21452): Launched 12:37:17.838922 run iperf3-srv_10.42.42.10(pid=21453): Launched 12:37:17.955253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:37:18.159572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:18.466875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21454): Launched 12:37:18.735683 run iperf3-srv_10.42.42.10(pid=21455): Launched 12:37:18.850570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:37:19.054807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:19.362489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21456): Launched 12:37:19.630327 run iperf3-srv_10.42.42.10(pid=21457): Launched 12:37:19.746211 tst iperf3m4.py:8: start network... 12:37:19.950092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:20.423159 run create_hlr_db(pid=21458): Launched 12:37:20.547240 bus /gobi_6: Setting Powered False 12:37:21.607800 run create_hlr_db(pid=21458): Terminated: ok {rc=0} 12:37:22.032093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21460): Launched 12:37:22.338521 run osmo-hlr_10.42.42.2(pid=21461): Launched 12:37:22.455000 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:22.977263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21463): Launched 12:37:23.282663 run osmo-stp_10.42.42.5(pid=21464): Launched 12:37:23.398964 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:23.922047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21466): Launched 12:37:24.039797 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:24.296557 run patchelf(pid=21467): Launched 12:37:24.468068 run osmo-stp_10.42.42.5(pid=21464): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21464)] 12:37:24.597595 run osmo-stp_10.42.42.5(pid=21464): stdout: | (launched: 2022-12-13_12:37:23.225480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:24.728424 run osmo-stp_10.42.42.5(pid=21464): stderr: | 20221213123723394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123723394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123723394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123723395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123723395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123723395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123723395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:24.858854 run osmo-stp_10.42.42.5(pid=21464): stdout: | (launched: 2022-12-13_12:37:23.225480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:24.983122 run osmo-stp_10.42.42.5(pid=21464): stderr: | 20221213123723394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123723394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123723394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123723395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123723395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123723395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123723395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:25.130334 run patchelf(pid=21467): Terminating (SIGINT) 12:37:25.300802 run patchelf(pid=21467): Terminated: ok {rc=0} 12:37:25.423977 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21464): Process ended prematurely: osmo-stp_10.42.42.5(pid=21464) [trial-2389↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21464)] [trial-2389↪gprs:nanobts+band-1900↪iperf3m4.py:8] 12:37:25.433662 tst iperf3m4.py:8: Test FAILED (10.6 sec) 12:37:25.460695 run osmo-hlr_10.42.42.2(pid=21461): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21461)] 12:37:25.508002 run osmo-hlr_10.42.42.2(pid=21461): stdout: | (launched: 2022-12-13_12:37:22.281146) 12:37:25.556774 run osmo-hlr_10.42.42.2(pid=21461): stderr: | 20221213123722457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123722457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123722457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123722457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123722458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123722458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123722472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123722481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123722481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123722482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:25.605957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21450): Terminating (SIGTERM) 12:37:25.645413 run iperf3-srv_10.42.42.10(pid=21451): Terminating (SIGTERM) 12:37:25.684842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21452): Terminating (SIGTERM) 12:37:25.724360 run iperf3-srv_10.42.42.10(pid=21453): Terminating (SIGTERM) 12:37:25.763660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21454): Terminating (SIGTERM) 12:37:25.803193 run iperf3-srv_10.42.42.10(pid=21455): Terminating (SIGTERM) 12:37:25.842395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21456): Terminating (SIGTERM) 12:37:25.881624 run iperf3-srv_10.42.42.10(pid=21457): Terminating (SIGTERM) 12:37:25.920692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21460): Terminating (SIGTERM) 12:37:25.959891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21463): Terminating (SIGTERM) 12:37:25.999098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21466): Terminating (SIGTERM) 12:37:26.038765 --- ParallelTerminationStrategy: PID 21450 died... 12:37:26.058141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21450): Terminated: ok {rc=0} 12:37:26.102173 --- ParallelTerminationStrategy: PID 21451 died... 12:37:26.121012 run iperf3-srv_10.42.42.10(pid=21451): Terminated {rc=256} 12:37:26.164488 --- ParallelTerminationStrategy: PID 21452 died... 12:37:26.183120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21452): Terminated: ok {rc=0} 12:37:26.226914 --- ParallelTerminationStrategy: PID 21453 died... 12:37:26.245476 run iperf3-srv_10.42.42.10(pid=21453): Terminated {rc=256} 12:37:26.288823 --- ParallelTerminationStrategy: PID 21454 died... 12:37:26.307962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21454): Terminated: ok {rc=0} 12:37:26.351759 --- ParallelTerminationStrategy: PID 21455 died... 12:37:26.370478 run iperf3-srv_10.42.42.10(pid=21455): Terminated {rc=256} 12:37:26.414034 --- ParallelTerminationStrategy: PID 21456 died... 12:37:26.432702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21456): Terminated: ok {rc=0} 12:37:26.476452 --- ParallelTerminationStrategy: PID 21457 died... 12:37:26.495165 run iperf3-srv_10.42.42.10(pid=21457): Terminated {rc=256} 12:37:26.538509 --- ParallelTerminationStrategy: PID 21460 died... 12:37:26.557159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21460): Terminated: ok {rc=0} 12:37:26.600740 --- ParallelTerminationStrategy: PID 21463 died... 12:37:26.619777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21463): Terminated: ok {rc=0} 12:37:26.663418 --- ParallelTerminationStrategy: PID 21466 died... 12:37:26.682252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21466): Terminated: ok {rc=0} 12:37:26.767828 bus /gobi_4: Setting Powered False 12:37:27.867993 bus /gobi_4: Setting Powered False 12:37:28.983199 bus /gobi_1: Setting Powered False 12:37:30.082623 bus /gobi_1: Setting Powered False 12:37:31.210978 bus /gobi_0: Setting Powered False 12:37:32.326823 bus /gobi_0: Setting Powered False 12:37:33.445232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 12:37:34.548364 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:34.559870 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:37:34.602649 tst ping.py: using LAC 33993 12:37:34.719606 tst ping.py: using RAC 78 12:37:34.836525 tst ping.py: using CellId 33993 12:37:34.951136 tst ping.py: using BVCI 33994 12:37:35.058251 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:35.068931 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:35.079614 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:35.090146 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:35.100536 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:35.111562 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:35.122454 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:35.133276 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:37:35.247143 tst ping.py:19: start network... 12:37:35.446901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:35.908280 run create_hlr_db(pid=21468): Launched 12:37:36.030089 bus /gobi_6: Setting Powered False 12:37:37.089880 run create_hlr_db(pid=21468): Terminated: ok {rc=0} 12:37:37.506948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21470): Launched 12:37:37.806204 run osmo-hlr_10.42.42.2(pid=21471): Launched 12:37:37.920077 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:38.434529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21473): Launched 12:37:38.735283 run osmo-stp_10.42.42.5(pid=21474): Launched 12:37:38.849662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:39.364770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21476): Launched 12:37:39.479557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:39.732435 run patchelf(pid=21477): Launched 12:37:39.899218 run osmo-stp_10.42.42.5(pid=21474): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21474)] 12:37:40.026703 run osmo-stp_10.42.42.5(pid=21474): stdout: | (launched: 2022-12-13_12:37:38.678846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:40.154872 run osmo-stp_10.42.42.5(pid=21474): stderr: | 20221213123738848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123738848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123738848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123738849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123738849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123738849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123738849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:40.283504 run osmo-stp_10.42.42.5(pid=21474): stdout: | (launched: 2022-12-13_12:37:38.678846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:40.405910 run osmo-stp_10.42.42.5(pid=21474): stderr: | 20221213123738848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123738848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123738848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123738849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123738849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123738849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123738849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:40.551061 run patchelf(pid=21477): Terminating (SIGINT) 12:37:40.718844 run patchelf(pid=21477): Terminated: ok {rc=0} 12:37:40.839990 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21474): Process ended prematurely: osmo-stp_10.42.42.5(pid=21474) [trial-2389↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21474)] [trial-2389↪gprs:nanobts+band-1900↪ping.py:22] 12:37:40.849193 tst ping.py:22: Test FAILED (6.3 sec) 12:37:40.876076 run osmo-hlr_10.42.42.2(pid=21471): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21471)] 12:37:40.923401 run osmo-hlr_10.42.42.2(pid=21471): stdout: | (launched: 2022-12-13_12:37:37.750740) 12:37:40.972296 run osmo-hlr_10.42.42.2(pid=21471): stderr: | 20221213123737926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123737926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123737926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123737926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123737926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123737926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123737938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123737947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123737948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123737948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:41.021672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21470): Terminating (SIGTERM) 12:37:41.061093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21473): Terminating (SIGTERM) 12:37:41.100604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21476): Terminating (SIGTERM) 12:37:41.140376 --- ParallelTerminationStrategy: PID 21470 died... 12:37:41.159760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21470): Terminated: ok {rc=0} 12:37:41.203500 --- ParallelTerminationStrategy: PID 21473 died... 12:37:41.222261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21473): Terminated: ok {rc=0} 12:37:41.266140 --- ParallelTerminationStrategy: PID 21476 died... 12:37:41.284861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21476): Terminated: ok {rc=0} 12:37:41.370691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 12:37:42.457667 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:42.469330 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:37:42.508543 tst ping_idle_ping.py: using LAC 33994 12:37:42.631254 tst ping_idle_ping.py: using RAC 79 12:37:42.748885 tst ping_idle_ping.py: using CellId 33994 12:37:42.865458 tst ping_idle_ping.py: using BVCI 33995 12:37:42.973430 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:42.984135 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:42.994854 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:43.005539 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:43.016106 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:43.026982 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:43.037842 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:37:43.048549 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:37:43.163228 tst ping_idle_ping.py:24: start network... 12:37:43.365315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:43.833404 run create_hlr_db(pid=21478): Launched 12:37:43.957838 bus /gobi_6: Setting Powered False 12:37:45.018865 run create_hlr_db(pid=21478): Terminated: ok {rc=0} 12:37:45.461308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21480): Launched 12:37:45.786467 run osmo-hlr_10.42.42.2(pid=21481): Launched 12:37:45.981339 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:46.681563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21483): Launched 12:37:47.013668 run osmo-stp_10.42.42.5(pid=21484): Launched 12:37:47.282650 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:47.800237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21486): Launched 12:37:47.915044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:48.169121 run patchelf(pid=21487): Launched 12:37:48.335606 run osmo-stp_10.42.42.5(pid=21484): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21484)] 12:37:48.462585 run osmo-stp_10.42.42.5(pid=21484): stdout: | (launched: 2022-12-13_12:37:46.950121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:48.590718 run osmo-stp_10.42.42.5(pid=21484): stderr: | 20221213123747151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123747151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123747152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123747152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123747153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123747153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123747153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:48.719398 run osmo-stp_10.42.42.5(pid=21484): stdout: | (launched: 2022-12-13_12:37:46.950121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:48.842696 run osmo-stp_10.42.42.5(pid=21484): stderr: | 20221213123747151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123747151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123747152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123747152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123747153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123747153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123747153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:48.988743 run patchelf(pid=21487): Terminating (SIGINT) 12:37:49.155521 run patchelf(pid=21487): Terminated: ok {rc=0} 12:37:49.276236 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21484): Process ended prematurely: osmo-stp_10.42.42.5(pid=21484) [trial-2389↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21484)] [trial-2389↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 12:37:49.285298 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:37:49.312050 run osmo-hlr_10.42.42.2(pid=21481): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21481)] 12:37:49.359346 run osmo-hlr_10.42.42.2(pid=21481): stdout: | (launched: 2022-12-13_12:37:45.726807) 12:37:49.408670 run osmo-hlr_10.42.42.2(pid=21481): stderr: | 20221213123746043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123746043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123746043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123746043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123746043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123746044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123746063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123746077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123746077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123746077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:49.458036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21480): Terminating (SIGTERM) 12:37:49.497463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21483): Terminating (SIGTERM) 12:37:49.536652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21486): Terminating (SIGTERM) 12:37:49.576522 --- ParallelTerminationStrategy: PID 21480 died... 12:37:49.596014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21480): Terminated: ok {rc=0} 12:37:49.640074 --- ParallelTerminationStrategy: PID 21483 died... 12:37:49.658805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21483): Terminated: ok {rc=0} 12:37:49.702815 --- ParallelTerminationStrategy: PID 21486 died... 12:37:49.721765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21486): Terminated: ok {rc=0} 12:37:49.806741 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 12:37:51.106780 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:51.113383 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:37:51.137426 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:37:51.176830 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:37:51.266896 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:37:51.293100 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:37:51.333646 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:37:51.946594 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:37:51.996284 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:52.007445 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:37:52.050763 tst cs_paging_gprs_active.py: using LAC 33995 12:37:52.171655 tst cs_paging_gprs_active.py: using RAC 80 12:37:52.290797 tst cs_paging_gprs_active.py: using CellId 33995 12:37:52.410387 tst cs_paging_gprs_active.py: using BVCI 33996 12:37:52.522389 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:52.533755 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:52.544662 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:52.555715 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:52.566898 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:52.578096 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:52.589426 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:52.600465 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:52.611724 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:37:52.732218 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:37:52.850989 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:37:53.055568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:53.362059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21491): Launched 12:37:53.631566 run iperf3-srv_10.42.42.10(pid=21492): Launched 12:37:53.746374 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:37:53.950888 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:54.258462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21493): Launched 12:37:54.526517 run iperf3-srv_10.42.42.10(pid=21494): Launched 12:37:54.642618 tst cs_paging_gprs_active.py:38: start network... 12:37:54.847237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:55.319203 run create_hlr_db(pid=21495): Launched 12:37:55.444129 bus /gobi_6: Setting Powered False 12:37:56.505797 run create_hlr_db(pid=21495): Terminated: ok {rc=0} 12:37:56.952128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21497): Launched 12:37:57.281750 run osmo-hlr_10.42.42.2(pid=21498): Launched 12:37:57.407978 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:57.971759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21500): Launched 12:37:58.301128 run osmo-stp_10.42.42.5(pid=21501): Launched 12:37:58.428918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:58.993062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21503): Launched 12:37:59.119572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:59.396776 run patchelf(pid=21504): Launched 12:37:59.581200 run osmo-stp_10.42.42.5(pid=21501): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21501)] 12:37:59.719508 run osmo-stp_10.42.42.5(pid=21501): stdout: | (launched: 2022-12-13_12:37:58.241066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:59.860110 run osmo-stp_10.42.42.5(pid=21501): stderr: | 20221213123758434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123758434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123758434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123758434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123758435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123758435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123758435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:00.000357 run osmo-stp_10.42.42.5(pid=21501): stdout: | (launched: 2022-12-13_12:37:58.241066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:00.134265 run osmo-stp_10.42.42.5(pid=21501): stderr: | 20221213123758434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123758434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123758434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123758434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123758435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123758435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123758435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:00.292417 run patchelf(pid=21504): Terminating (SIGINT) 12:38:00.475628 run patchelf(pid=21504): Terminated: ok {rc=0} 12:38:00.607215 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21501): Process ended prematurely: osmo-stp_10.42.42.5(pid=21501) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21501)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:38:00.617685 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:38:00.646234 run osmo-hlr_10.42.42.2(pid=21498): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21498)] 12:38:00.696649 run osmo-hlr_10.42.42.2(pid=21498): stdout: | (launched: 2022-12-13_12:37:57.221582) 12:38:00.749127 run osmo-hlr_10.42.42.2(pid=21498): stderr: | 20221213123757420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123757420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123757420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123757420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123757420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123757420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123757434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123757443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123757443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123757444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:00.801696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21491): Terminating (SIGTERM) 12:38:00.849141 run iperf3-srv_10.42.42.10(pid=21492): Terminating (SIGTERM) 12:38:00.902444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21493): Terminating (SIGTERM) 12:38:00.952540 run iperf3-srv_10.42.42.10(pid=21494): Terminating (SIGTERM) 12:38:00.998523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21497): Terminating (SIGTERM) 12:38:01.045885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21500): Terminating (SIGTERM) 12:38:01.100501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21503): Terminating (SIGTERM) 12:38:01.154685 --- ParallelTerminationStrategy: PID 21491 died... 12:38:01.180441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21491): Terminated: ok {rc=0} 12:38:01.243557 --- ParallelTerminationStrategy: PID 21492 died... 12:38:01.264013 run iperf3-srv_10.42.42.10(pid=21492): Terminated {rc=256} 12:38:01.310079 --- ParallelTerminationStrategy: PID 21493 died... 12:38:01.329949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21493): Terminated: ok {rc=0} 12:38:01.375926 --- ParallelTerminationStrategy: PID 21494 died... 12:38:01.397236 run iperf3-srv_10.42.42.10(pid=21494): Terminated {rc=256} 12:38:01.442988 --- ParallelTerminationStrategy: PID 21497 died... 12:38:01.462742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21497): Terminated: ok {rc=0} 12:38:01.507794 --- ParallelTerminationStrategy: PID 21500 died... 12:38:01.527459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21500): Terminated: ok {rc=0} 12:38:01.573697 --- ParallelTerminationStrategy: PID 21503 died... 12:38:01.594548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21503): Terminated: ok {rc=0} 12:38:01.688642 bus /gobi_0: Setting Powered False 12:38:02.803965 bus /gobi_0: Setting Powered False 12:38:03.919705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:38:05.067772 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:05.079962 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:38:05.125607 tst iperf3.py: using LAC 33996 12:38:05.255311 tst iperf3.py: using RAC 81 12:38:05.382646 tst iperf3.py: using CellId 33996 12:38:05.511375 tst iperf3.py: using BVCI 33997 12:38:05.631506 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:05.643036 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:05.654388 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:05.665694 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:05.677211 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:05.688575 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:05.700320 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:05.711798 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:05.723436 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:38:05.840074 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:38:06.046141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:06.352385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21505): Launched 12:38:06.619738 run iperf3-srv_10.42.42.10(pid=21506): Launched 12:38:06.734288 tst iperf3.py:8: start network... 12:38:06.939893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:07.412722 run create_hlr_db(pid=21507): Launched 12:38:07.538750 bus /gobi_6: Setting Powered False 12:38:08.602988 run create_hlr_db(pid=21507): Terminated: ok {rc=0} 12:38:09.055693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21509): Launched 12:38:09.383730 run osmo-hlr_10.42.42.2(pid=21510): Launched 12:38:09.511504 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:10.078577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21512): Launched 12:38:10.407096 run osmo-stp_10.42.42.5(pid=21513): Launched 12:38:10.534597 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:38:11.099370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21515): Launched 12:38:11.226562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:38:11.504451 run patchelf(pid=21516): Launched 12:38:11.688268 run osmo-stp_10.42.42.5(pid=21513): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21513)] 12:38:11.827635 run osmo-stp_10.42.42.5(pid=21513): stdout: | (launched: 2022-12-13_12:38:10.347303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:11.968153 run osmo-stp_10.42.42.5(pid=21513): stderr: | 20221213123810538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123810538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123810539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123810539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123810539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123810540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123810540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:12.108792 run osmo-stp_10.42.42.5(pid=21513): stdout: | (launched: 2022-12-13_12:38:10.347303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:12.243198 run osmo-stp_10.42.42.5(pid=21513): stderr: | 20221213123810538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123810538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123810539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123810539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123810539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123810540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123810540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:12.402541 run patchelf(pid=21516): Terminating (SIGINT) 12:38:12.586182 run patchelf(pid=21516): Terminated: ok {rc=0} 12:38:12.718938 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21513): Process ended prematurely: osmo-stp_10.42.42.5(pid=21513) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21513)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 12:38:12.729334 tst iperf3.py:8: Test FAILED (7.7 sec) 12:38:12.758153 run osmo-hlr_10.42.42.2(pid=21510): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21510)] 12:38:12.809594 run osmo-hlr_10.42.42.2(pid=21510): stdout: | (launched: 2022-12-13_12:38:09.323822) 12:38:12.862247 run osmo-hlr_10.42.42.2(pid=21510): stderr: | 20221213123809524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123809524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123809524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123809524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123809524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123809524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123809537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123809546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123809546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123809546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:12.915690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21505): Terminating (SIGTERM) 12:38:12.958076 run iperf3-srv_10.42.42.10(pid=21506): Terminating (SIGTERM) 12:38:13.000696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21509): Terminating (SIGTERM) 12:38:13.043022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21512): Terminating (SIGTERM) 12:38:13.085788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21515): Terminating (SIGTERM) 12:38:13.129104 --- ParallelTerminationStrategy: PID 21505 died... 12:38:13.149852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21505): Terminated: ok {rc=0} 12:38:13.196820 --- ParallelTerminationStrategy: PID 21506 died... 12:38:13.217528 run iperf3-srv_10.42.42.10(pid=21506): Terminated {rc=256} 12:38:13.264310 --- ParallelTerminationStrategy: PID 21509 died... 12:38:13.284379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21509): Terminated: ok {rc=0} 12:38:13.330913 --- ParallelTerminationStrategy: PID 21512 died... 12:38:13.350912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21512): Terminated: ok {rc=0} 12:38:13.397485 --- ParallelTerminationStrategy: PID 21515 died... 12:38:13.418074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21515): Terminated: ok {rc=0} 12:38:13.506568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:38:14.658419 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:14.670503 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:38:14.714551 tst iperf3m4.py: using LAC 33997 12:38:14.844058 tst iperf3m4.py: using RAC 82 12:38:14.973680 tst iperf3m4.py: using CellId 33997 12:38:15.098299 tst iperf3m4.py: using BVCI 33998 12:38:15.211097 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:15.222456 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:15.233578 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:15.244752 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:15.255880 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:15.266935 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:15.278064 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:15.288932 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:15.300038 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:38:15.421394 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:38:15.543817 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:38:15.662418 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:38:15.785363 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:38:16.038324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:16.377345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21517): Launched 12:38:16.684434 run iperf3-srv_10.42.42.10(pid=21518): Launched 12:38:16.826457 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:38:17.056089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:17.390429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21519): Launched 12:38:17.660928 run iperf3-srv_10.42.42.10(pid=21520): Launched 12:38:17.778691 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:38:17.985456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:18.294132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21521): Launched 12:38:18.562783 run iperf3-srv_10.42.42.10(pid=21522): Launched 12:38:18.678138 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:38:18.884046 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:19.193579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21523): Launched 12:38:19.462806 run iperf3-srv_10.42.42.10(pid=21524): Launched 12:38:19.578257 tst iperf3m4.py:8: start network... 12:38:19.785343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:20.262825 run create_hlr_db(pid=21525): Launched 12:38:20.388083 bus /gobi_6: Setting Powered False 12:38:21.450017 run create_hlr_db(pid=21525): Terminated: ok {rc=0} 12:38:21.878249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21527): Launched 12:38:22.186435 run osmo-hlr_10.42.42.2(pid=21528): Launched 12:38:22.302794 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:22.846137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21530): Launched 12:38:23.153686 run osmo-stp_10.42.42.5(pid=21531): Launched 12:38:23.270252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:38:23.798546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21533): Launched 12:38:23.917365 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:38:24.176399 run patchelf(pid=21534): Launched 12:38:24.348235 run osmo-stp_10.42.42.5(pid=21531): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21531)] 12:38:24.478624 run osmo-stp_10.42.42.5(pid=21531): stdout: | (launched: 2022-12-13_12:38:23.096676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:24.609862 run osmo-stp_10.42.42.5(pid=21531): stderr: | 20221213123823266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123823266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123823266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123823267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123823267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123823267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123823267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:24.740899 run osmo-stp_10.42.42.5(pid=21531): stdout: | (launched: 2022-12-13_12:38:23.096676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:24.866769 run osmo-stp_10.42.42.5(pid=21531): stderr: | 20221213123823266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123823266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123823266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123823267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123823267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123823267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123823267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:25.015178 run patchelf(pid=21534): Terminating (SIGINT) 12:38:25.187696 run patchelf(pid=21534): Terminated: ok {rc=0} 12:38:25.311615 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21531): Process ended prematurely: osmo-stp_10.42.42.5(pid=21531) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21531)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 12:38:25.321283 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:38:25.348875 run osmo-hlr_10.42.42.2(pid=21528): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21528)] 12:38:25.396823 run osmo-hlr_10.42.42.2(pid=21528): stdout: | (launched: 2022-12-13_12:38:22.129405) 12:38:25.446665 run osmo-hlr_10.42.42.2(pid=21528): stderr: | 20221213123822305 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123822305 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123822305 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123822305 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123822305 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123822305 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123822317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123822326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123822326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123822326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:25.496461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21517): Terminating (SIGTERM) 12:38:25.536302 run iperf3-srv_10.42.42.10(pid=21518): Terminating (SIGTERM) 12:38:25.575858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21519): Terminating (SIGTERM) 12:38:25.615575 run iperf3-srv_10.42.42.10(pid=21520): Terminating (SIGTERM) 12:38:25.655224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21521): Terminating (SIGTERM) 12:38:25.694845 run iperf3-srv_10.42.42.10(pid=21522): Terminating (SIGTERM) 12:38:25.734391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21523): Terminating (SIGTERM) 12:38:25.774131 run iperf3-srv_10.42.42.10(pid=21524): Terminating (SIGTERM) 12:38:25.814249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21527): Terminating (SIGTERM) 12:38:25.854195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21530): Terminating (SIGTERM) 12:38:25.894165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21533): Terminating (SIGTERM) 12:38:25.934868 --- ParallelTerminationStrategy: PID 21517 died... 12:38:25.954519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21517): Terminated: ok {rc=0} 12:38:25.999104 --- ParallelTerminationStrategy: PID 21518 died... 12:38:26.018059 run iperf3-srv_10.42.42.10(pid=21518): Terminated {rc=256} 12:38:26.062087 --- ParallelTerminationStrategy: PID 21519 died... 12:38:26.080700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21519): Terminated: ok {rc=0} 12:38:26.124240 --- ParallelTerminationStrategy: PID 21520 died... 12:38:26.142936 run iperf3-srv_10.42.42.10(pid=21520): Terminated {rc=256} 12:38:26.186216 --- ParallelTerminationStrategy: PID 21521 died... 12:38:26.204733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21521): Terminated: ok {rc=0} 12:38:26.248236 --- ParallelTerminationStrategy: PID 21522 died... 12:38:26.266614 run iperf3-srv_10.42.42.10(pid=21522): Terminated {rc=256} 12:38:26.310051 --- ParallelTerminationStrategy: PID 21523 died... 12:38:26.328643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21523): Terminated: ok {rc=0} 12:38:26.372033 --- ParallelTerminationStrategy: PID 21524 died... 12:38:26.390595 run iperf3-srv_10.42.42.10(pid=21524): Terminated {rc=256} 12:38:26.433906 --- ParallelTerminationStrategy: PID 21527 died... 12:38:26.452398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21527): Terminated: ok {rc=0} 12:38:26.495766 --- ParallelTerminationStrategy: PID 21530 died... 12:38:26.514281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21530): Terminated: ok {rc=0} 12:38:26.557718 --- ParallelTerminationStrategy: PID 21533 died... 12:38:26.576233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21533): Terminated: ok {rc=0} 12:38:26.660883 bus /gobi_4: Setting Powered False 12:38:27.759754 bus /gobi_4: Setting Powered False 12:38:28.872391 bus /gobi_1: Setting Powered False 12:38:29.970219 bus /gobi_1: Setting Powered False 12:38:31.085955 bus /gobi_0: Setting Powered False 12:38:32.191824 bus /gobi_0: Setting Powered False 12:38:33.308234 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 12:38:34.412412 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:34.424118 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:38:34.465880 tst ping.py: using LAC 33998 12:38:34.586358 tst ping.py: using RAC 83 12:38:34.713778 tst ping.py: using CellId 33998 12:38:34.841904 tst ping.py: using BVCI 33999 12:38:34.960755 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:34.972409 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:34.983906 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:34.995400 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:35.007655 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:35.019934 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:35.032507 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:35.044830 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:38:35.161837 tst ping.py:19: start network... 12:38:35.363211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:35.826907 run create_hlr_db(pid=21535): Launched 12:38:35.951677 bus /gobi_6: Setting Powered False 12:38:37.011512 run create_hlr_db(pid=21535): Terminated: ok {rc=0} 12:38:37.451005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Launched 12:38:37.773726 run osmo-hlr_10.42.42.2(pid=21538): Launched 12:38:37.897659 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:38.454870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Launched 12:38:38.759610 run osmo-stp_10.42.42.5(pid=21541): Launched 12:38:38.873091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:38:39.389567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21543): Launched 12:38:39.504102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:38:39.758122 run patchelf(pid=21544): Launched 12:38:39.924433 run osmo-stp_10.42.42.5(pid=21541): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] 12:38:40.050679 run osmo-stp_10.42.42.5(pid=21541): stdout: | (launched: 2022-12-13_12:38:38.704285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:40.179599 run osmo-stp_10.42.42.5(pid=21541): stderr: | 20221213123838875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123838875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123838875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123838876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123838876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123838876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123838876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:40.307895 run osmo-stp_10.42.42.5(pid=21541): stdout: | (launched: 2022-12-13_12:38:38.704285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:40.430009 run osmo-stp_10.42.42.5(pid=21541): stderr: | 20221213123838875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123838875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123838875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123838876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123838876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123838876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123838876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:40.574975 run patchelf(pid=21544): Terminating (SIGINT) 12:38:40.741882 run patchelf(pid=21544): Terminated: ok {rc=0} 12:38:40.862457 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21541): Process ended prematurely: osmo-stp_10.42.42.5(pid=21541) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 12:38:40.871443 tst ping.py:22: Test FAILED (6.5 sec) 12:38:40.898545 run osmo-hlr_10.42.42.2(pid=21538): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21538)] 12:38:40.946205 run osmo-hlr_10.42.42.2(pid=21538): stdout: | (launched: 2022-12-13_12:38:37.714751) 12:38:40.995541 run osmo-hlr_10.42.42.2(pid=21538): stderr: | 20221213123837913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123837913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123837913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123837913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123837914 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123837914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123837926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123837934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123837934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123837934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:41.045341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Terminating (SIGTERM) 12:38:41.085130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Terminating (SIGTERM) 12:38:41.125321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21543): Terminating (SIGTERM) 12:38:41.165678 --- ParallelTerminationStrategy: PID 21537 died... 12:38:41.184987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Terminated: ok {rc=0} 12:38:41.229839 --- ParallelTerminationStrategy: PID 21540 died... 12:38:41.248708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Terminated: ok {rc=0} 12:38:41.292621 --- ParallelTerminationStrategy: PID 21543 died... 12:38:41.311413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21543): Terminated: ok {rc=0} 12:38:41.398091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:38:42.490229 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:42.502677 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:38:42.547114 tst ping_idle_ping.py: using LAC 33999 12:38:42.675219 tst ping_idle_ping.py: using RAC 84 12:38:42.802637 tst ping_idle_ping.py: using CellId 33999 12:38:42.928418 tst ping_idle_ping.py: using BVCI 34000 12:38:43.045631 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:43.057548 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:43.069149 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:43.080703 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:43.092731 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:43.104720 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:43.117117 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:38:43.129009 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:38:43.249605 tst ping_idle_ping.py:24: start network... 12:38:43.453684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:43.925673 run create_hlr_db(pid=21545): Launched 12:38:44.049360 bus /gobi_6: Setting Powered False 12:38:45.109687 run create_hlr_db(pid=21545): Terminated: ok {rc=0} 12:38:45.551275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21547): Launched 12:38:45.900054 run osmo-hlr_10.42.42.2(pid=21548): Launched 12:38:46.152652 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:46.883659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21554): Launched 12:38:47.240051 run osmo-stp_10.42.42.5(pid=21575): Launched 12:38:47.503736 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:38:48.232247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21616): Launched 12:38:48.408898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:38:48.736261 run patchelf(pid=21662): Launched 12:38:48.964684 run osmo-stp_10.42.42.5(pid=21575): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21575)] 12:38:49.103545 run osmo-stp_10.42.42.5(pid=21575): stdout: | (launched: 2022-12-13_12:38:47.180549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:49.250846 run osmo-stp_10.42.42.5(pid=21575): stderr: | 20221213123847539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123847539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123847540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123847540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123847553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123847553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123847553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:49.413330 run osmo-stp_10.42.42.5(pid=21575): stdout: | (launched: 2022-12-13_12:38:47.180549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:49.566354 run osmo-stp_10.42.42.5(pid=21575): stderr: | 20221213123847539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123847539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123847540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123847540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123847553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123847553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123847553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:49.750899 run patchelf(pid=21662): Terminating (SIGINT) 12:38:49.962988 run patchelf(pid=21662): Terminated: ok {rc=0} 12:38:50.111429 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21575): Process ended prematurely: osmo-stp_10.42.42.5(pid=21575) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21575)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 12:38:50.121530 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 12:38:50.150955 run osmo-hlr_10.42.42.2(pid=21548): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21548)] 12:38:50.199249 run osmo-hlr_10.42.42.2(pid=21548): stdout: | (launched: 2022-12-13_12:38:45.816750) 12:38:50.249929 run osmo-hlr_10.42.42.2(pid=21548): stderr: | 20221213123846233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123846233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123846233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123846234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123846234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123846234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123846258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123846281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123846281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123846281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:50.305329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21547): Terminating (SIGTERM) 12:38:50.347907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21554): Terminating (SIGTERM) 12:38:50.390889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21616): Terminating (SIGTERM) 12:38:50.436787 --- ParallelTerminationStrategy: PID 21547 died... 12:38:50.457752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21547): Terminated: ok {rc=0} 12:38:50.504682 --- ParallelTerminationStrategy: PID 21554 died... 12:38:50.524180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21554): Terminated: ok {rc=0} 12:38:50.569537 --- ParallelTerminationStrategy: PID 21616 died... 12:38:50.589821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21616): Terminated: ok {rc=0} 12:38:50.677051 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:38:51.976610 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:51.984238 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:38:52.009160 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:38:52.048544 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:38:52.135559 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:38:52.160378 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:38:52.200212 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:38:52.797659 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:38:52.848692 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:52.860882 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:38:52.924375 tst cs_paging_gprs_active.py: using LAC 34000 12:38:53.047049 tst cs_paging_gprs_active.py: using RAC 85 12:38:53.169625 tst cs_paging_gprs_active.py: using CellId 34000 12:38:53.290447 tst cs_paging_gprs_active.py: using BVCI 34001 12:38:53.404279 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:53.416531 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:53.428451 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:53.440374 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:53.453682 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:53.466276 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:53.478889 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:53.491224 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:53.503914 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:38:53.626361 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:38:53.746864 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:38:53.955236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:54.267718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21830): Launched 12:38:54.555105 run iperf3-srv_10.42.42.10(pid=21831): Launched 12:38:54.690072 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:38:54.900229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:55.215865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21832): Launched 12:38:55.504207 run iperf3-srv_10.42.42.10(pid=21833): Launched 12:38:55.641738 tst cs_paging_gprs_active.py:38: start network... 12:38:55.852741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:56.342339 run create_hlr_db(pid=21834): Launched 12:38:56.508569 bus /gobi_6: Setting Powered False 12:38:57.571303 run create_hlr_db(pid=21834): Terminated: ok {rc=0} 12:38:58.030001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21836): Launched 12:38:58.376140 run osmo-hlr_10.42.42.2(pid=21837): Launched 12:38:58.624200 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:59.292177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21839): Launched 12:38:59.636824 run osmo-stp_10.42.42.5(pid=21840): Launched 12:38:59.884746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:00.536078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21842): Launched 12:39:00.672693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:00.982053 run patchelf(pid=21843): Launched 12:39:01.171515 run osmo-stp_10.42.42.5(pid=21840): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21840)] 12:39:01.332701 run osmo-stp_10.42.42.5(pid=21840): stdout: | (launched: 2022-12-13_12:38:59.575734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:01.502876 run osmo-stp_10.42.42.5(pid=21840): stderr: | 20221213123859870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123859871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123859871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123859871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123859872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123859872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123859872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:01.666219 run osmo-stp_10.42.42.5(pid=21840): stdout: | (launched: 2022-12-13_12:38:59.575734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:01.824263 run osmo-stp_10.42.42.5(pid=21840): stderr: | 20221213123859870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123859871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123859871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123859871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123859872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123859872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123859872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:02.010412 run patchelf(pid=21843): Terminating (SIGINT) 12:39:02.216871 run patchelf(pid=21843): Terminated: ok {rc=0} 12:39:02.369127 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21840): Process ended prematurely: osmo-stp_10.42.42.5(pid=21840) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21840)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:39:02.381908 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 12:39:02.413117 run osmo-hlr_10.42.42.2(pid=21837): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21837)] 12:39:02.468861 run osmo-hlr_10.42.42.2(pid=21837): stdout: | (launched: 2022-12-13_12:38:58.312371) 12:39:02.527391 run osmo-hlr_10.42.42.2(pid=21837): stderr: | 20221213123858618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123858618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123858618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123858618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123858618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123858618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123858638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123858651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123858651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123858651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:02.587735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21830): Terminating (SIGTERM) 12:39:02.635946 run iperf3-srv_10.42.42.10(pid=21831): Terminating (SIGTERM) 12:39:02.686510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21832): Terminating (SIGTERM) 12:39:02.735185 run iperf3-srv_10.42.42.10(pid=21833): Terminating (SIGTERM) 12:39:02.784390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21836): Terminating (SIGTERM) 12:39:02.833347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21839): Terminating (SIGTERM) 12:39:02.881612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21842): Terminating (SIGTERM) 12:39:02.929826 --- ParallelTerminationStrategy: PID 21830 died... 12:39:02.952528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21830): Terminated: ok {rc=0} 12:39:03.007507 --- ParallelTerminationStrategy: PID 21831 died... 12:39:03.031048 run iperf3-srv_10.42.42.10(pid=21831): Terminated {rc=256} 12:39:03.080605 --- ParallelTerminationStrategy: PID 21832 died... 12:39:03.103231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21832): Terminated: ok {rc=0} 12:39:03.154454 --- ParallelTerminationStrategy: PID 21833 died... 12:39:03.176757 run iperf3-srv_10.42.42.10(pid=21833): Terminated {rc=256} 12:39:03.230372 --- ParallelTerminationStrategy: PID 21836 died... 12:39:03.254394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21836): Terminated: ok {rc=0} 12:39:03.306261 --- ParallelTerminationStrategy: PID 21839 died... 12:39:03.329274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21839): Terminated: ok {rc=0} 12:39:03.381595 --- ParallelTerminationStrategy: PID 21842 died... 12:39:03.408005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21842): Terminated: ok {rc=0} 12:39:03.498757 bus /gobi_0: Setting Powered False 12:39:04.604185 bus /gobi_0: Setting Powered False 12:39:05.725296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:39:06.884167 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:06.897637 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:39:06.969232 tst iperf3.py: using LAC 34001 12:39:07.098967 tst iperf3.py: using RAC 86 12:39:07.229474 tst iperf3.py: using CellId 34001 12:39:07.358998 tst iperf3.py: using BVCI 34002 12:39:07.483791 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:07.496495 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:07.509009 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:07.521692 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:07.535425 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:07.549684 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:07.563369 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:07.576513 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:07.590148 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:39:07.716617 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:39:07.945825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:39:08.286151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21847): Launched 12:39:08.590963 run iperf3-srv_10.42.42.10(pid=21848): Launched 12:39:08.732077 tst iperf3.py:8: start network... 12:39:08.960344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:09.482077 run create_hlr_db(pid=21849): Launched 12:39:09.648770 bus /gobi_6: Setting Powered False 12:39:10.715310 run create_hlr_db(pid=21849): Terminated: ok {rc=0} 12:39:11.162064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21852): Launched 12:39:11.470482 run osmo-hlr_10.42.42.2(pid=21853): Launched 12:39:11.586450 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:12.116283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21855): Launched 12:39:12.422360 run osmo-stp_10.42.42.5(pid=21856): Launched 12:39:12.539212 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:13.064750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21858): Launched 12:39:13.182831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:13.440426 run patchelf(pid=21859): Launched 12:39:13.612199 run osmo-stp_10.42.42.5(pid=21856): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21856)] 12:39:13.741527 run osmo-stp_10.42.42.5(pid=21856): stdout: | (launched: 2022-12-13_12:39:12.365579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:13.872067 run osmo-stp_10.42.42.5(pid=21856): stderr: | 20221213123912536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123912536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123912536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123912537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123912537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123912537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123912537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:14.002924 run osmo-stp_10.42.42.5(pid=21856): stdout: | (launched: 2022-12-13_12:39:12.365579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:14.127479 run osmo-stp_10.42.42.5(pid=21856): stderr: | 20221213123912536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123912536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123912536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123912537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123912537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123912537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123912537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:14.275254 run patchelf(pid=21859): Terminating (SIGINT) 12:39:14.446029 run patchelf(pid=21859): Terminated: ok {rc=0} 12:39:14.569504 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21856): Process ended prematurely: osmo-stp_10.42.42.5(pid=21856) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21856)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 12:39:14.579100 tst iperf3.py:8: Test FAILED (7.7 sec) 12:39:14.606324 run osmo-hlr_10.42.42.2(pid=21853): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21853)] 12:39:14.653616 run osmo-hlr_10.42.42.2(pid=21853): stdout: | (launched: 2022-12-13_12:39:11.413129) 12:39:14.702622 run osmo-hlr_10.42.42.2(pid=21853): stderr: | 20221213123911589 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123911589 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123911589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123911589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123911589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123911589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123911602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123911610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123911611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123911611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:14.752209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21847): Terminating (SIGTERM) 12:39:14.791787 run iperf3-srv_10.42.42.10(pid=21848): Terminating (SIGTERM) 12:39:14.831389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21852): Terminating (SIGTERM) 12:39:14.870915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21855): Terminating (SIGTERM) 12:39:14.910377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21858): Terminating (SIGTERM) 12:39:14.950053 --- ParallelTerminationStrategy: PID 21847 died... 12:39:14.969116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21847): Terminated: ok {rc=0} 12:39:15.012821 --- ParallelTerminationStrategy: PID 21848 died... 12:39:15.031858 run iperf3-srv_10.42.42.10(pid=21848): Terminated {rc=256} 12:39:15.075387 --- ParallelTerminationStrategy: PID 21852 died... 12:39:15.094027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21852): Terminated: ok {rc=0} 12:39:15.137864 --- ParallelTerminationStrategy: PID 21855 died... 12:39:15.156476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21855): Terminated: ok {rc=0} 12:39:15.200082 --- ParallelTerminationStrategy: PID 21858 died... 12:39:15.218792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21858): Terminated: ok {rc=0} 12:39:15.301843 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:39:16.469666 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:16.485194 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:39:16.555030 tst iperf3m4.py: using LAC 34002 12:39:16.712143 tst iperf3m4.py: using RAC 87 12:39:16.879742 tst iperf3m4.py: using CellId 34002 12:39:17.001407 tst iperf3m4.py: using BVCI 34003 12:39:17.118758 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:17.130683 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:17.142839 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:17.154916 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:17.167119 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:17.178783 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:17.190777 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:17.203637 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:17.215155 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:39:17.332884 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:39:17.457423 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:39:17.579515 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:39:17.699602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:39:17.922237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:39:18.252075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21860): Launched 12:39:18.540517 run iperf3-srv_10.42.42.10(pid=21861): Launched 12:39:18.665633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:39:18.887580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:39:19.218677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21862): Launched 12:39:19.508415 run iperf3-srv_10.42.42.10(pid=21863): Launched 12:39:19.633981 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:39:19.855807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:39:20.186366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21864): Launched 12:39:20.475173 run iperf3-srv_10.42.42.10(pid=21865): Launched 12:39:20.599741 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:39:20.821501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:39:21.151852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21866): Launched 12:39:21.439591 run iperf3-srv_10.42.42.10(pid=21867): Launched 12:39:21.564901 tst iperf3m4.py:8: start network... 12:39:21.786991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:22.294349 run create_hlr_db(pid=21868): Launched 12:39:22.419962 bus /gobi_6: Setting Powered False 12:39:23.480352 run create_hlr_db(pid=21868): Terminated: ok {rc=0} 12:39:23.917952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21870): Launched 12:39:24.225337 run osmo-hlr_10.42.42.2(pid=21871): Launched 12:39:24.341772 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:24.869005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21873): Launched 12:39:25.174790 run osmo-stp_10.42.42.5(pid=21874): Launched 12:39:25.292384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:25.820260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21876): Launched 12:39:25.937808 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:26.196139 run patchelf(pid=21877): Launched 12:39:26.368474 run osmo-stp_10.42.42.5(pid=21874): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21874)] 12:39:26.497732 run osmo-stp_10.42.42.5(pid=21874): stdout: | (launched: 2022-12-13_12:39:25.118131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:26.628294 run osmo-stp_10.42.42.5(pid=21874): stderr: | 20221213123925287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123925287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123925287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123925288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123925288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123925288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123925288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:26.758995 run osmo-stp_10.42.42.5(pid=21874): stdout: | (launched: 2022-12-13_12:39:25.118131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:26.883529 run osmo-stp_10.42.42.5(pid=21874): stderr: | 20221213123925287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123925287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123925287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123925288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123925288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123925288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123925288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:27.031275 run patchelf(pid=21877): Terminating (SIGINT) 12:39:27.201725 run patchelf(pid=21877): Terminated: ok {rc=0} 12:39:27.325330 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21874): Process ended prematurely: osmo-stp_10.42.42.5(pid=21874) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21874)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:39:27.334893 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:39:27.362425 run osmo-hlr_10.42.42.2(pid=21871): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21871)] 12:39:27.409526 run osmo-hlr_10.42.42.2(pid=21871): stdout: | (launched: 2022-12-13_12:39:24.168454) 12:39:27.458285 run osmo-hlr_10.42.42.2(pid=21871): stderr: | 20221213123924342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123924342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123924342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123924342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123924342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123924342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123924354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123924362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123924363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123924363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:27.507512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21860): Terminating (SIGTERM) 12:39:27.546698 run iperf3-srv_10.42.42.10(pid=21861): Terminating (SIGTERM) 12:39:27.586353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21862): Terminating (SIGTERM) 12:39:27.625577 run iperf3-srv_10.42.42.10(pid=21863): Terminating (SIGTERM) 12:39:27.664502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21864): Terminating (SIGTERM) 12:39:27.703431 run iperf3-srv_10.42.42.10(pid=21865): Terminating (SIGTERM) 12:39:27.742367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21866): Terminating (SIGTERM) 12:39:27.781347 run iperf3-srv_10.42.42.10(pid=21867): Terminating (SIGTERM) 12:39:27.820275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21870): Terminating (SIGTERM) 12:39:27.859452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21873): Terminating (SIGTERM) 12:39:27.898412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21876): Terminating (SIGTERM) 12:39:27.937730 --- ParallelTerminationStrategy: PID 21860 died... 12:39:27.956448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21860): Terminated: ok {rc=0} 12:39:28.000208 --- ParallelTerminationStrategy: PID 21861 died... 12:39:28.018779 run iperf3-srv_10.42.42.10(pid=21861): Terminated {rc=256} 12:39:28.062400 --- ParallelTerminationStrategy: PID 21862 died... 12:39:28.081066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21862): Terminated: ok {rc=0} 12:39:28.124568 --- ParallelTerminationStrategy: PID 21863 died... 12:39:28.143204 run iperf3-srv_10.42.42.10(pid=21863): Terminated {rc=256} 12:39:28.186502 --- ParallelTerminationStrategy: PID 21864 died... 12:39:28.205102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21864): Terminated: ok {rc=0} 12:39:28.248571 --- ParallelTerminationStrategy: PID 21865 died... 12:39:28.267127 run iperf3-srv_10.42.42.10(pid=21865): Terminated {rc=256} 12:39:28.310487 --- ParallelTerminationStrategy: PID 21866 died... 12:39:28.329165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21866): Terminated: ok {rc=0} 12:39:28.372542 --- ParallelTerminationStrategy: PID 21867 died... 12:39:28.391033 run iperf3-srv_10.42.42.10(pid=21867): Terminated {rc=256} 12:39:28.434361 --- ParallelTerminationStrategy: PID 21870 died... 12:39:28.452759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21870): Terminated: ok {rc=0} 12:39:28.496273 --- ParallelTerminationStrategy: PID 21873 died... 12:39:28.515006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21873): Terminated: ok {rc=0} 12:39:28.558404 --- ParallelTerminationStrategy: PID 21876 died... 12:39:28.577100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21876): Terminated: ok {rc=0} 12:39:28.659631 bus /gobi_4: Setting Powered False 12:39:29.755363 bus /gobi_4: Setting Powered False 12:39:30.881733 bus /gobi_1: Setting Powered False 12:39:31.988376 bus /gobi_1: Setting Powered False 12:39:33.102174 bus /gobi_0: Setting Powered False 12:39:34.201178 bus /gobi_0: Setting Powered False 12:39:35.317758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:39:36.421489 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:36.433773 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:39:36.497939 tst ping.py: using LAC 34003 12:39:36.617825 tst ping.py: using RAC 88 12:39:36.735603 tst ping.py: using CellId 34003 12:39:36.857845 tst ping.py: using BVCI 34004 12:39:36.967380 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:36.978709 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:36.989773 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:37.000791 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:37.011745 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:37.022682 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:37.033682 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:37.044482 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:39:37.159071 tst ping.py:19: start network... 12:39:37.359838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:37.827498 run create_hlr_db(pid=21878): Launched 12:39:37.951286 bus /gobi_6: Setting Powered False 12:39:39.011773 run create_hlr_db(pid=21878): Terminated: ok {rc=0} 12:39:39.453844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21880): Launched 12:39:39.779485 run osmo-hlr_10.42.42.2(pid=21881): Launched 12:39:39.904829 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:40.472502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21883): Launched 12:39:40.796311 run osmo-stp_10.42.42.5(pid=21884): Launched 12:39:40.920943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:41.476084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21886): Launched 12:39:41.601676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:41.873064 run patchelf(pid=21887): Launched 12:39:42.053306 run osmo-stp_10.42.42.5(pid=21884): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21884)] 12:39:42.188785 run osmo-stp_10.42.42.5(pid=21884): stdout: | (launched: 2022-12-13_12:39:40.736818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:42.325776 run osmo-stp_10.42.42.5(pid=21884): stderr: | 20221213123940929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123940929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123940929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123940930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123940930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123940930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123940930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:42.463635 run osmo-stp_10.42.42.5(pid=21884): stdout: | (launched: 2022-12-13_12:39:40.736818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:42.595019 run osmo-stp_10.42.42.5(pid=21884): stderr: | 20221213123940929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123940929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123940929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123940930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123940930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123940930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123940930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:42.750696 run patchelf(pid=21887): Terminating (SIGINT) 12:39:42.929037 run patchelf(pid=21887): Terminated: ok {rc=0} 12:39:43.058201 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21884): Process ended prematurely: osmo-stp_10.42.42.5(pid=21884) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21884)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 12:39:43.067896 tst ping.py:22: Test FAILED (6.6 sec) 12:39:43.095981 run osmo-hlr_10.42.42.2(pid=21881): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21881)] 12:39:43.146272 run osmo-hlr_10.42.42.2(pid=21881): stdout: | (launched: 2022-12-13_12:39:39.719924) 12:39:43.198287 run osmo-hlr_10.42.42.2(pid=21881): stderr: | 20221213123939918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123939918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123939918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123939918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123939918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123939918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123939930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123939938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123939938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123939938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:43.250544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21880): Terminating (SIGTERM) 12:39:43.292554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21883): Terminating (SIGTERM) 12:39:43.335012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21886): Terminating (SIGTERM) 12:39:43.377797 --- ParallelTerminationStrategy: PID 21880 died... 12:39:43.398208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21880): Terminated: ok {rc=0} 12:39:43.444869 --- ParallelTerminationStrategy: PID 21883 died... 12:39:43.464713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21883): Terminated: ok {rc=0} 12:39:43.511065 --- ParallelTerminationStrategy: PID 21886 died... 12:39:43.530807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21886): Terminated: ok {rc=0} 12:39:43.617905 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:39:44.705567 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:44.718080 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:39:44.782607 tst ping_idle_ping.py: using LAC 34004 12:39:44.909758 tst ping_idle_ping.py: using RAC 89 12:39:45.034730 tst ping_idle_ping.py: using CellId 34004 12:39:45.161579 tst ping_idle_ping.py: using BVCI 34005 12:39:45.271563 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:45.282698 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:45.293645 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:45.304531 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:45.315348 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:45.326228 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:45.337449 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:39:45.348273 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:39:45.467728 tst ping_idle_ping.py:24: start network... 12:39:45.670401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:46.159918 run create_hlr_db(pid=21889): Launched 12:39:46.323893 bus /gobi_6: Setting Powered False 12:39:47.388809 run create_hlr_db(pid=21889): Terminated: ok {rc=0} 12:39:47.825596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21891): Launched 12:39:48.129917 run osmo-hlr_10.42.42.2(pid=21892): Launched 12:39:48.245447 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:48.776635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21894): Launched 12:39:49.077522 run osmo-stp_10.42.42.5(pid=21895): Launched 12:39:49.191688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:49.711787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21897): Launched 12:39:49.827195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:50.080640 run patchelf(pid=21898): Launched 12:39:50.247386 run osmo-stp_10.42.42.5(pid=21895): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21895)] 12:39:50.373948 run osmo-stp_10.42.42.5(pid=21895): stdout: | (launched: 2022-12-13_12:39:49.021198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:50.502310 run osmo-stp_10.42.42.5(pid=21895): stderr: | 20221213123949191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123949191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123949191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123949192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123949194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123949194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123949194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:50.630608 run osmo-stp_10.42.42.5(pid=21895): stdout: | (launched: 2022-12-13_12:39:49.021198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:50.752553 run osmo-stp_10.42.42.5(pid=21895): stderr: | 20221213123949191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123949191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123949191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123949192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123949194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123949194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123949194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:50.898687 run patchelf(pid=21898): Terminating (SIGINT) 12:39:51.066125 run patchelf(pid=21898): Terminated: ok {rc=0} 12:39:51.186896 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21895): Process ended prematurely: osmo-stp_10.42.42.5(pid=21895) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21895)] [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:39:51.195830 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:39:51.222671 run osmo-hlr_10.42.42.2(pid=21892): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21892)] 12:39:51.269865 run osmo-hlr_10.42.42.2(pid=21892): stdout: | (launched: 2022-12-13_12:39:48.073245) 12:39:51.318728 run osmo-hlr_10.42.42.2(pid=21892): stderr: | 20221213123948251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123948251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123948251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123948251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123948251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123948251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123948263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123948272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123948273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123948273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:51.368197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21891): Terminating (SIGTERM) 12:39:51.407843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21894): Terminating (SIGTERM) 12:39:51.447522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21897): Terminating (SIGTERM) 12:39:51.487413 --- ParallelTerminationStrategy: PID 21891 died... 12:39:51.506204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21891): Terminated: ok {rc=0} 12:39:51.549919 --- ParallelTerminationStrategy: PID 21894 died... 12:39:51.568300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21894): Terminated: ok {rc=0} 12:39:51.612086 --- ParallelTerminationStrategy: PID 21897 died... 12:39:51.630720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21897): Terminated: ok {rc=0} 12:39:51.715856 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 12:39:53.012150 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:39:53.019558 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:39:53.043448 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:39:53.079313 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:39:53.135215 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:39:53.161104 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:39:53.197052 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:39:53.757697 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:39:53.763772 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:53.775936 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:39:53.838036 tst switch_tch_pdch.py: using LAC 34005 12:39:53.955473 tst switch_tch_pdch.py: using RAC 90 12:39:54.082752 tst switch_tch_pdch.py: using CellId 34005 12:39:54.208387 tst switch_tch_pdch.py: using BVCI 34006 12:39:54.326223 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:54.338524 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:54.350840 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:54.362930 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:54.375153 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:54.387415 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:54.399798 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:54.412106 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:39:54.528074 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:39:54.648780 tst switch_tch_pdch.py:51: start network... 12:39:54.866482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:55.363135 run create_hlr_db(pid=21902): Launched 12:39:55.486199 bus /gobi_6: Setting Powered False 12:39:56.550256 run create_hlr_db(pid=21902): Terminated: ok {rc=0} 12:39:56.998262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21904): Launched 12:39:57.320456 run osmo-hlr_10.42.42.2(pid=21905): Launched 12:39:57.445437 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:57.999176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21907): Launched 12:39:58.321675 run osmo-stp_10.42.42.5(pid=21908): Launched 12:39:58.446037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:59.000682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21910): Launched 12:39:59.123418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:59.395013 run patchelf(pid=21911): Launched 12:39:59.575510 run osmo-stp_10.42.42.5(pid=21908): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21908)] 12:39:59.711680 run osmo-stp_10.42.42.5(pid=21908): stdout: | (launched: 2022-12-13_12:39:58.262462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:59.849445 run osmo-stp_10.42.42.5(pid=21908): stderr: | 20221213123958455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123958455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123958455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123958456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123958456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123958456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123958456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:59.987172 run osmo-stp_10.42.42.5(pid=21908): stdout: | (launched: 2022-12-13_12:39:58.262462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:00.118598 run osmo-stp_10.42.42.5(pid=21908): stderr: | 20221213123958455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213123958455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213123958455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213123958456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213123958456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213123958456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213123958456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:00.274570 run patchelf(pid=21911): Terminating (SIGINT) 12:40:00.453945 run patchelf(pid=21911): Terminated: ok {rc=0} 12:40:00.583124 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21908): Process ended prematurely: osmo-stp_10.42.42.5(pid=21908) [trial-2389↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21908)] [trial-2389↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:40:00.592791 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 12:40:00.621068 run osmo-hlr_10.42.42.2(pid=21905): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21905)] 12:40:00.671687 run osmo-hlr_10.42.42.2(pid=21905): stdout: | (launched: 2022-12-13_12:39:57.261075) 12:40:00.723702 run osmo-hlr_10.42.42.2(pid=21905): stderr: | 20221213123957461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213123957461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213123957461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213123957461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213123957461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213123957461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213123957473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213123957483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213123957483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213123957483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:00.776589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21904): Terminating (SIGTERM) 12:40:00.818502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21907): Terminating (SIGTERM) 12:40:00.876579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21910): Terminating (SIGTERM) 12:40:00.919140 --- ParallelTerminationStrategy: PID 21904 died... 12:40:00.939720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21904): Terminated: ok {rc=0} 12:40:00.987003 --- ParallelTerminationStrategy: PID 21907 died... 12:40:01.007703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21907): Terminated: ok {rc=0} 12:40:01.055075 --- ParallelTerminationStrategy: PID 21910 died... 12:40:01.075730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21910): Terminated: ok {rc=0} 12:40:01.164406 bus /gobi_0: Setting Powered False 12:40:02.271045 bus /gobi_0: Setting Powered False 12:40:03.384630 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 sms:nanobts+band-900 --------------------------------------------------------------------- 12:40:04.634162 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:04.639428 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:40:04.672307 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:40:04.700331 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 12:40:04.753567 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:40:04.786767 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:40:04.814371 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 12:40:05.361200 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 12:40:05.366576 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:05.377330 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 12:40:05.423120 tst mo_mt_sms.py: using LAC 34006 12:40:05.541103 tst mo_mt_sms.py: using RAC 91 12:40:05.659313 tst mo_mt_sms.py: using CellId 34006 12:40:05.776577 tst mo_mt_sms.py: using BVCI 34007 12:40:05.886102 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:05.896917 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:05.907729 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:05.918418 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:05.929112 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:05.940026 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 12:40:06.053741 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 12:40:06.171649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:06.669229 run create_hlr_db(pid=21919): Launched 12:40:06.792158 bus /gobi_6: Setting Powered False 12:40:07.856537 run create_hlr_db(pid=21919): Terminated: ok {rc=0} 12:40:08.286620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21921): Launched 12:40:08.587735 run osmo-hlr_10.42.42.2(pid=21922): Launched 12:40:08.703216 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:09.222206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21924): Launched 12:40:09.524582 run osmo-stp_10.42.42.5(pid=21925): Launched 12:40:09.638424 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:10.181508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21927): Launched 12:40:10.483565 run osmo-msc_10.42.42.6(pid=21928): Launched 12:40:10.652141 run osmo-stp_10.42.42.5(pid=21925): ERR: Terminated: ERROR {rc=1} [trial-2389↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21925)] 12:40:10.778822 run osmo-stp_10.42.42.5(pid=21925): stdout: | (launched: 2022-12-13_12:40:09.467063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:10.905754 run osmo-stp_10.42.42.5(pid=21925): stderr: | 20221213124009641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124009642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124009642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124009642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124009643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124009643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124009643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:11.030538 run osmo-stp_10.42.42.5(pid=21925): stdout: | (launched: 2022-12-13_12:40:09.467063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:11.150241 run osmo-stp_10.42.42.5(pid=21925): stderr: | 20221213124009641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124009642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124009642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124009642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124009643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124009643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124009643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:11.293133 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21925): Process ended prematurely: osmo-stp_10.42.42.5(pid=21925) [trial-2389↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21925)] [trial-2389↪sms:nanobts+band-900↪mo_mt_sms.py:16] 12:40:11.301953 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 12:40:11.328136 run osmo-hlr_10.42.42.2(pid=21922): ERR: Terminated: ERROR {rc=237} [trial-2389↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21922)] 12:40:11.375634 run osmo-hlr_10.42.42.2(pid=21922): stdout: | (launched: 2022-12-13_12:40:08.531695) 12:40:11.424663 run osmo-hlr_10.42.42.2(pid=21922): stderr: | 20221213124008710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124008710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124008710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124008710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124008710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124008710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124008726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124008736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124008736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124008736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:11.493374 run osmo-msc_10.42.42.6(pid=21928): ERR: Terminated: ERROR {rc=2} [trial-2389↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21928)] 12:40:11.540832 run osmo-msc_10.42.42.6(pid=21928): stdout: | (launched: 2022-12-13_12:40:10.427192) 12:40:11.590119 run osmo-msc_10.42.42.6(pid=21928): stderr: | 20221213124010699 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124010699 DLGLOBAL DEBUG validating counter group 0x7f87c3fbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124010700 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124010700 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124010700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124010700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124010702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124010702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124010702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124010702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:11.639687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21921): Terminating (SIGTERM) 12:40:11.679458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21924): Terminating (SIGTERM) 12:40:11.719059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21927): Terminating (SIGTERM) 12:40:11.758999 --- ParallelTerminationStrategy: PID 21921 died... 12:40:11.778324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21921): Terminated: ok {rc=0} 12:40:11.822324 --- ParallelTerminationStrategy: PID 21924 died... 12:40:11.841148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21924): Terminated: ok {rc=0} 12:40:11.885049 --- ParallelTerminationStrategy: PID 21927 died... 12:40:11.903976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21927): Terminated: ok {rc=0} 12:40:11.990496 bus /sierra_3: Setting Powered False 12:40:13.090808 bus /sierra_3: Setting Powered False 12:40:14.205323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 12:40:15.446197 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:15.451396 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:40:15.485045 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 12:40:15.492814 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 12:40:15.529911 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:40:15.563341 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 12:40:15.570506 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 12:40:16.091313 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 12:40:16.099665 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 12:40:16.116031 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 12:40:16.179908 tst assert_extension.py: using LAC 34007 12:40:16.336224 tst assert_extension.py: using RAC 92 12:40:16.464909 tst assert_extension.py: using CellId 34007 12:40:16.595905 tst assert_extension.py: using BVCI 34008 12:40:16.708746 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 12:40:16.822788 tst assert_extension.py:10: start nitb and bts... 12:40:17.029247 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:40:17.648764 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21933): Launched 12:40:17.950207 run osmo-nitb_10.42.42.2(pid=21934): Launched 12:40:18.119781 run osmo-nitb_10.42.42.2(pid=21934): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21934)] 12:40:18.254658 run osmo-nitb_10.42.42.2(pid=21934): stdout: | (launched: 2022-12-13_12:40:17.894197) 12:40:18.391328 run osmo-nitb_10.42.42.2(pid=21934): stderr: | (launched: 2022-12-13_12:40:17.938522) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:40:18.527858 run osmo-nitb_10.42.42.2(pid=21934): stdout: | (launched: 2022-12-13_12:40:17.894197) 12:40:18.658691 run osmo-nitb_10.42.42.2(pid=21934): stderr: | (launched: 2022-12-13_12:40:17.938522) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21934): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21934) [trial-2389↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21934)] 12:40:19.066507 tst osmo-nitb_10.42.42.2(pid=21934): stdout: | (launched: 2022-12-13_12:40:17.894197) 12:40:19.188811 tst osmo-nitb_10.42.42.2(pid=21934): stderr: | (launched: 2022-12-13_12:40:17.938522) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:40:19.332395 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21934): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21934) [trial-2389↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21934)] [trial-2389↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 12:40:19.341207 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:40:19.348016 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21933): Terminating (SIGTERM) 12:40:19.556608 --- ParallelTerminationStrategy: PID 21933 died... 12:40:19.577266 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21933): Terminated: ok {rc=0} 12:40:19.664049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 ussd:nanobts+band-900 --------------------------------------------------------------------- 12:40:20.855167 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:20.861757 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:40:20.896528 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:40:20.924209 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 12:40:20.961809 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:40:20.995241 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:40:21.022803 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 12:40:21.553345 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 12:40:21.558624 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:21.569926 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 12:40:21.619706 tst assert_extension.py: using LAC 34008 12:40:21.738532 tst assert_extension.py: using RAC 93 12:40:21.857350 tst assert_extension.py: using CellId 34008 12:40:21.975385 tst assert_extension.py: using BVCI 34009 12:40:22.085948 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:22.096694 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:22.107667 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:22.118446 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:22.129069 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:40:22.139918 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 12:40:22.253799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:22.720899 run create_hlr_db(pid=21938): Launched 12:40:22.843838 bus /sierra_2: Setting Powered False 12:40:23.903349 run create_hlr_db(pid=21938): Terminated: ok {rc=0} 12:40:24.323813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21940): Launched 12:40:24.627264 run osmo-hlr_10.42.42.2(pid=21941): Launched 12:40:24.741811 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:25.260267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21943): Launched 12:40:25.560331 run osmo-stp_10.42.42.5(pid=21944): Launched 12:40:25.675420 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:26.216075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21946): Launched 12:40:26.515524 run osmo-msc_10.42.42.6(pid=21947): Launched 12:40:26.686037 run osmo-stp_10.42.42.5(pid=21944): ERR: Terminated: ERROR {rc=1} [trial-2389↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21944)] 12:40:26.812206 run osmo-stp_10.42.42.5(pid=21944): stdout: | (launched: 2022-12-13_12:40:25.504350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:26.938639 run osmo-stp_10.42.42.5(pid=21944): stderr: | 20221213124025679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124025679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124025679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124025680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124025680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124025680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124025680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:27.062458 run osmo-stp_10.42.42.5(pid=21944): stdout: | (launched: 2022-12-13_12:40:25.504350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:27.181326 run osmo-stp_10.42.42.5(pid=21944): stderr: | 20221213124025679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124025679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124025679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124025680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124025680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124025680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124025680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:27.322820 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21944): Process ended prematurely: osmo-stp_10.42.42.5(pid=21944) [trial-2389↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21944)] [trial-2389↪ussd:nanobts+band-900↪assert_extension.py:17] 12:40:27.331134 tst assert_extension.py:17: Test FAILED (5.8 sec) 12:40:27.356760 run osmo-hlr_10.42.42.2(pid=21941): ERR: Terminated: ERROR {rc=237} [trial-2389↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21941)] 12:40:27.403864 run osmo-hlr_10.42.42.2(pid=21941): stdout: | (launched: 2022-12-13_12:40:24.571041) 12:40:27.452716 run osmo-hlr_10.42.42.2(pid=21941): stderr: | 20221213124024750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124024750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124024750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124024750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124024750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124024751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124024762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124024771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124024772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124024772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:27.521187 run osmo-msc_10.42.42.6(pid=21947): ERR: Terminated: ERROR {rc=2} [trial-2389↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21947)] 12:40:27.568045 run osmo-msc_10.42.42.6(pid=21947): stdout: | (launched: 2022-12-13_12:40:26.459788) 12:40:27.617041 run osmo-msc_10.42.42.6(pid=21947): stderr: | 20221213124026731 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124026731 DLGLOBAL DEBUG validating counter group 0x7f477e7f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124026732 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124026732 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124026732 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124026732 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124026734 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124026734 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124026734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124026735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:27.666242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21940): Terminating (SIGTERM) 12:40:27.706035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21943): Terminating (SIGTERM) 12:40:27.745616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21946): Terminating (SIGTERM) 12:40:27.785307 --- ParallelTerminationStrategy: PID 21940 died... 12:40:27.804405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21940): Terminated: ok {rc=0} 12:40:27.848319 --- ParallelTerminationStrategy: PID 21943 died... 12:40:27.867011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21943): Terminated: ok {rc=0} 12:40:27.910522 --- ParallelTerminationStrategy: PID 21946 died... 12:40:27.929178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21946): Terminated: ok {rc=0} 12:40:28.011710 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:40:29.227060 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:29.235192 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:40:29.268606 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:40:29.297878 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:40:29.352804 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:40:29.386815 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:40:29.414852 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:40:29.962922 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:40:30.014292 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:30.025609 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:40:30.094640 tst mo_mt_call.py: using LAC 34009 12:40:30.215688 tst mo_mt_call.py: using RAC 94 12:40:30.336940 tst mo_mt_call.py: using CellId 34009 12:40:30.459761 tst mo_mt_call.py: using BVCI 34010 12:40:30.571310 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:30.582657 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:30.593799 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:30.604802 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:30.616063 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:30.627165 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:40:30.745240 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:40:30.880929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:31.419953 run create_hlr_db(pid=21952): Launched 12:40:31.584495 bus /sierra_2: Setting Powered False 12:40:32.646277 run create_hlr_db(pid=21952): Terminated: ok {rc=0} 12:40:33.094839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21954): Launched 12:40:33.421916 run osmo-hlr_10.42.42.2(pid=21955): Launched 12:40:33.549317 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:34.114877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21957): Launched 12:40:34.443091 run osmo-stp_10.42.42.5(pid=21958): Launched 12:40:34.570783 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:35.160148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21960): Launched 12:40:35.488425 run osmo-msc_10.42.42.6(pid=21961): Launched 12:40:35.675427 run osmo-stp_10.42.42.5(pid=21958): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21958)] 12:40:35.814041 run osmo-stp_10.42.42.5(pid=21958): stdout: | (launched: 2022-12-13_12:40:34.383031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:35.952366 run osmo-stp_10.42.42.5(pid=21958): stderr: | 20221213124034575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124034575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124034575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124034576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124034576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124034576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124034576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:36.089186 run osmo-stp_10.42.42.5(pid=21958): stdout: | (launched: 2022-12-13_12:40:34.383031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:36.219313 run osmo-stp_10.42.42.5(pid=21958): stderr: | 20221213124034575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124034575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124034575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124034576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124034576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124034576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124034576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:36.374637 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21958): Process ended prematurely: osmo-stp_10.42.42.5(pid=21958) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21958)] [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:40:36.384540 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:40:36.412670 run osmo-hlr_10.42.42.2(pid=21955): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21955)] 12:40:36.463530 run osmo-hlr_10.42.42.2(pid=21955): stdout: | (launched: 2022-12-13_12:40:33.361777) 12:40:36.515957 run osmo-hlr_10.42.42.2(pid=21955): stderr: | 20221213124033561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124033561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124033561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124033561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124033561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124033561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124033576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124033586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124033587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124033587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:36.589359 run osmo-msc_10.42.42.6(pid=21961): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21961)] 12:40:36.639773 run osmo-msc_10.42.42.6(pid=21961): stdout: | (launched: 2022-12-13_12:40:35.427912) 12:40:36.691821 run osmo-msc_10.42.42.6(pid=21961): stderr: | 20221213124035750 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124035750 DLGLOBAL DEBUG validating counter group 0x7f6f44a1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124035750 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124035750 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124035750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124035750 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124035752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124035752 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124035752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124035753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:36.744146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21954): Terminating (SIGTERM) 12:40:36.786080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21957): Terminating (SIGTERM) 12:40:36.827965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21960): Terminating (SIGTERM) 12:40:36.870735 --- ParallelTerminationStrategy: PID 21954 died... 12:40:36.891396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21954): Terminated: ok {rc=0} 12:40:36.937910 --- ParallelTerminationStrategy: PID 21957 died... 12:40:36.957943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21957): Terminated: ok {rc=0} 12:40:37.004195 --- ParallelTerminationStrategy: PID 21960 died... 12:40:37.024254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21960): Terminated: ok {rc=0} 12:40:37.112440 bus /sierra_3: Setting Powered False 12:40:38.211570 bus /sierra_3: Setting Powered False 12:40:39.329057 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:40:40.474468 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:40.486649 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:40:40.554666 tst mo_mt_call_osmux.py: using LAC 34010 12:40:40.674719 tst mo_mt_call_osmux.py: using RAC 95 12:40:40.796880 tst mo_mt_call_osmux.py: using CellId 34010 12:40:40.921765 tst mo_mt_call_osmux.py: using BVCI 34011 12:40:41.033955 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:41.045466 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:41.056686 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:41.068077 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:41.079446 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:40:41.090701 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:40:41.207704 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:40:41.325127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:41.799111 run create_hlr_db(pid=21963): Launched 12:40:41.925790 bus /sierra_2: Setting Powered False 12:40:42.989326 run create_hlr_db(pid=21963): Terminated: ok {rc=0} 12:40:43.444682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21965): Launched 12:40:43.774378 run osmo-hlr_10.42.42.2(pid=21966): Launched 12:40:43.899040 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:44.466111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21968): Launched 12:40:44.795436 run osmo-stp_10.42.42.5(pid=21969): Launched 12:40:44.920647 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:45.513020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21971): Launched 12:40:45.844939 run osmo-msc_10.42.42.6(pid=21972): Launched 12:40:46.203545 run osmo-stp_10.42.42.5(pid=21969): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21969)] 12:40:46.414400 run osmo-stp_10.42.42.5(pid=21969): stdout: | (launched: 2022-12-13_12:40:44.734497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:46.608399 run osmo-stp_10.42.42.5(pid=21969): stderr: | 20221213124044928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124044928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124044928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124044929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124044929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124044929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124044929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:46.777766 run osmo-stp_10.42.42.5(pid=21969): stdout: | (launched: 2022-12-13_12:40:44.734497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:46.906054 run osmo-stp_10.42.42.5(pid=21969): stderr: | 20221213124044928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124044928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124044928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124044929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124044929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124044929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124044929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:47.057985 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21969): Process ended prematurely: osmo-stp_10.42.42.5(pid=21969) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21969)] [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:40:47.068294 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:40:47.096840 run osmo-hlr_10.42.42.2(pid=21966): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21966)] 12:40:47.146570 run osmo-hlr_10.42.42.2(pid=21966): stdout: | (launched: 2022-12-13_12:40:43.713715) 12:40:47.197790 run osmo-hlr_10.42.42.2(pid=21966): stderr: | 20221213124043914 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124043914 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124043914 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124043914 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124043914 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124043914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124043927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124043937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124043938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124043938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:47.270620 run osmo-msc_10.42.42.6(pid=21972): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21972)] 12:40:47.319034 run osmo-msc_10.42.42.6(pid=21972): stdout: | (launched: 2022-12-13_12:40:45.781336) 12:40:47.369161 run osmo-msc_10.42.42.6(pid=21972): stderr: | 20221213124046384 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124046384 DLGLOBAL DEBUG validating counter group 0x7f8e3fbd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124046384 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124046385 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124046385 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124046385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124046387 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124046387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124046387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124046387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:47.419101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21965): Terminating (SIGTERM) 12:40:47.459144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21968): Terminating (SIGTERM) 12:40:47.499371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21971): Terminating (SIGTERM) 12:40:47.539842 --- ParallelTerminationStrategy: PID 21965 died... 12:40:47.559541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21965): Terminated: ok {rc=0} 12:40:47.604005 --- ParallelTerminationStrategy: PID 21968 died... 12:40:47.622854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21968): Terminated: ok {rc=0} 12:40:47.667224 --- ParallelTerminationStrategy: PID 21971 died... 12:40:47.686210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21971): Terminated: ok {rc=0} 12:40:47.772104 bus /sierra_3: Setting Powered False 12:40:48.871374 bus /sierra_3: Setting Powered False 12:40:49.987548 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:40:51.241256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:51.248275 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:40:51.280089 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:40:51.306744 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:40:51.359875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:40:51.392272 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:40:51.418967 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:40:51.974874 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:40:52.027991 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:40:52.039640 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:40:52.113150 tst mo_mt_call.py: using LAC 34011 12:40:52.239584 tst mo_mt_call.py: using RAC 96 12:40:52.365369 tst mo_mt_call.py: using CellId 34011 12:40:52.493753 tst mo_mt_call.py: using BVCI 34012 12:40:52.614082 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:40:52.625806 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:40:52.637326 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:40:52.648818 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:40:52.660663 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:40:52.672499 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:40:52.789209 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:40:52.908483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:53.414337 run create_hlr_db(pid=21977): Launched 12:40:53.539859 bus /sierra_2: Setting Powered False 12:40:54.604148 run create_hlr_db(pid=21977): Terminated: ok {rc=0} 12:40:55.042467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21979): Launched 12:40:55.348713 run osmo-hlr_10.42.42.2(pid=21980): Launched 12:40:55.465750 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:55.994382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21982): Launched 12:40:56.302271 run osmo-stp_10.42.42.5(pid=21983): Launched 12:40:56.420208 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:56.972446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21985): Launched 12:40:57.279831 run osmo-msc_10.42.42.6(pid=21986): Launched 12:40:57.451673 run osmo-stp_10.42.42.5(pid=21983): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21983)] 12:40:57.580676 run osmo-stp_10.42.42.5(pid=21983): stdout: | (launched: 2022-12-13_12:40:56.244151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:57.709504 run osmo-stp_10.42.42.5(pid=21983): stderr: | 20221213124056417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124056417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124056417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124056417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124056420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124056420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124056420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:57.837137 run osmo-stp_10.42.42.5(pid=21983): stdout: | (launched: 2022-12-13_12:40:56.244151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:57.958643 run osmo-stp_10.42.42.5(pid=21983): stderr: | 20221213124056417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124056417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124056417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124056417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124056420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124056420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124056420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:58.104104 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21983): Process ended prematurely: osmo-stp_10.42.42.5(pid=21983) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21983)] [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:40:58.113397 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:40:58.140076 run osmo-hlr_10.42.42.2(pid=21980): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21980)] 12:40:58.187885 run osmo-hlr_10.42.42.2(pid=21980): stdout: | (launched: 2022-12-13_12:40:55.292014) 12:40:58.237065 run osmo-hlr_10.42.42.2(pid=21980): stderr: | 20221213124055471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124055471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124055471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124055471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124055471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124055471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124055486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124055497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124055497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124055497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:58.306399 run osmo-msc_10.42.42.6(pid=21986): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21986)] 12:40:58.354019 run osmo-msc_10.42.42.6(pid=21986): stdout: | (launched: 2022-12-13_12:40:57.223085) 12:40:58.402867 run osmo-msc_10.42.42.6(pid=21986): stderr: | 20221213124057496 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124057496 DLGLOBAL DEBUG validating counter group 0x7ffbeef3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124057496 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124057496 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124057496 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124057497 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124057498 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124057499 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124057499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124057499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:58.454123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21979): Terminating (SIGTERM) 12:40:58.493793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21982): Terminating (SIGTERM) 12:40:58.533496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21985): Terminating (SIGTERM) 12:40:58.573415 --- ParallelTerminationStrategy: PID 21979 died... 12:40:58.592537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21979): Terminated: ok {rc=0} 12:40:58.637105 --- ParallelTerminationStrategy: PID 21982 died... 12:40:58.656154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21982): Terminated: ok {rc=0} 12:40:58.700270 --- ParallelTerminationStrategy: PID 21985 died... 12:40:58.719348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21985): Terminated: ok {rc=0} 12:40:58.806037 bus /sierra_3: Setting Powered False 12:40:59.903947 bus /sierra_3: Setting Powered False 12:41:01.016573 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:41:02.178640 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:41:02.192194 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:41:02.267251 tst mo_mt_call_osmux.py: using LAC 34012 12:41:02.396807 tst mo_mt_call_osmux.py: using RAC 97 12:41:02.527535 tst mo_mt_call_osmux.py: using CellId 34012 12:41:02.658153 tst mo_mt_call_osmux.py: using BVCI 34013 12:41:02.777070 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:41:02.788734 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:41:02.800253 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:41:02.811757 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:41:02.823680 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:41:02.835585 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:41:02.956545 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:41:03.079719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:03.558885 run create_hlr_db(pid=21988): Launched 12:41:03.689764 bus /sierra_2: Setting Powered False 12:41:04.750574 run create_hlr_db(pid=21988): Terminated: ok {rc=0} 12:41:05.198033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21990): Launched 12:41:05.526767 run osmo-hlr_10.42.42.2(pid=21991): Launched 12:41:05.654424 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:06.218573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21993): Launched 12:41:06.547145 run osmo-stp_10.42.42.5(pid=21994): Launched 12:41:06.675105 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:07.267050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21996): Launched 12:41:07.595782 run osmo-msc_10.42.42.6(pid=21997): Launched 12:41:07.778772 run osmo-stp_10.42.42.5(pid=21994): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21994)] 12:41:07.917231 run osmo-stp_10.42.42.5(pid=21994): stdout: | (launched: 2022-12-13_12:41:06.486534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:08.055760 run osmo-stp_10.42.42.5(pid=21994): stderr: | 20221213124106680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124106680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124106680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124106681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124106683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124106683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124106683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:08.193556 run osmo-stp_10.42.42.5(pid=21994): stdout: | (launched: 2022-12-13_12:41:06.486534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:08.323351 run osmo-stp_10.42.42.5(pid=21994): stderr: | 20221213124106680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124106680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124106680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124106681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124106683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124106683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124106683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:08.479548 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21994): Process ended prematurely: osmo-stp_10.42.42.5(pid=21994) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21994)] [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:41:08.489875 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:41:08.517802 run osmo-hlr_10.42.42.2(pid=21991): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21991)] 12:41:08.568471 run osmo-hlr_10.42.42.2(pid=21991): stdout: | (launched: 2022-12-13_12:41:05.466161) 12:41:08.620765 run osmo-hlr_10.42.42.2(pid=21991): stderr: | 20221213124105668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124105668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124105668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124105668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124105668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124105668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124105680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124105688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124105689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124105689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:08.693435 run osmo-msc_10.42.42.6(pid=21997): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21997)] 12:41:08.743196 run osmo-msc_10.42.42.6(pid=21997): stdout: | (launched: 2022-12-13_12:41:07.535181) 12:41:08.794866 run osmo-msc_10.42.42.6(pid=21997): stderr: | 20221213124107860 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124107860 DLGLOBAL DEBUG validating counter group 0x7fd2f5562c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124107860 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124107860 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124107860 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124107861 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124107862 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124107863 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124107863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124107863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:08.846863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21990): Terminating (SIGTERM) 12:41:08.888864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21993): Terminating (SIGTERM) 12:41:08.930888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21996): Terminating (SIGTERM) 12:41:08.974158 --- ParallelTerminationStrategy: PID 21990 died... 12:41:08.994537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21990): Terminated: ok {rc=0} 12:41:09.041052 --- ParallelTerminationStrategy: PID 21993 died... 12:41:09.061098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21993): Terminated: ok {rc=0} 12:41:09.107403 --- ParallelTerminationStrategy: PID 21996 died... 12:41:09.127331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21996): Terminated: ok {rc=0} 12:41:09.215554 bus /sierra_3: Setting Powered False 12:41:10.314249 bus /sierra_3: Setting Powered False 12:41:11.429053 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:41:12.683299 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:41:12.691369 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:41:12.724524 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:41:12.753397 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:41:12.807940 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:41:12.841764 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:41:12.869588 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:41:13.421415 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:41:13.474610 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:13.486606 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:41:13.560505 tst mo_mt_call.py: using LAC 34013 12:41:13.688426 tst mo_mt_call.py: using RAC 98 12:41:13.823513 tst mo_mt_call.py: using CellId 34013 12:41:13.951632 tst mo_mt_call.py: using BVCI 34014 12:41:14.070558 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:14.082423 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:14.094281 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:14.105814 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:14.117753 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:14.129783 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:41:14.246210 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:41:14.367003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:14.873945 run create_hlr_db(pid=22003): Launched 12:41:14.999835 bus /sierra_2: Setting Powered False 12:41:16.065704 run create_hlr_db(pid=22003): Terminated: ok {rc=0} 12:41:16.530899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22005): Launched 12:41:16.875610 run osmo-hlr_10.42.42.2(pid=22006): Launched 12:41:17.112725 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:17.649249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22008): Launched 12:41:17.954745 run osmo-stp_10.42.42.5(pid=22009): Launched 12:41:18.071874 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:18.623183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22011): Launched 12:41:18.931603 run osmo-msc_10.42.42.6(pid=22012): Launched 12:41:19.102950 run osmo-stp_10.42.42.5(pid=22009): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22009)] 12:41:19.231626 run osmo-stp_10.42.42.5(pid=22009): stdout: | (launched: 2022-12-13_12:41:17.898024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:19.360591 run osmo-stp_10.42.42.5(pid=22009): stderr: | 20221213124118069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124118069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124118069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124118070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124118072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124118072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124118072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:19.496445 run osmo-stp_10.42.42.5(pid=22009): stdout: | (launched: 2022-12-13_12:41:17.898024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:19.617440 run osmo-stp_10.42.42.5(pid=22009): stderr: | 20221213124118069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124118069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124118069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124118070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124118072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124118072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124118072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:19.762119 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22009): Process ended prematurely: osmo-stp_10.42.42.5(pid=22009) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22009)] [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:41:19.770922 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:41:19.797662 run osmo-hlr_10.42.42.2(pid=22006): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22006)] 12:41:19.845550 run osmo-hlr_10.42.42.2(pid=22006): stdout: | (launched: 2022-12-13_12:41:16.814971) 12:41:19.894576 run osmo-hlr_10.42.42.2(pid=22006): stderr: | 20221213124117128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124117128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124117128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124117128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124117128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124117128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124117146 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124117167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124117167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124117167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:19.963349 run osmo-msc_10.42.42.6(pid=22012): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22012)] 12:41:20.010656 run osmo-msc_10.42.42.6(pid=22012): stdout: | (launched: 2022-12-13_12:41:18.874012) 12:41:20.059594 run osmo-msc_10.42.42.6(pid=22012): stderr: | 20221213124119147 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124119147 DLGLOBAL DEBUG validating counter group 0x7f18dcea8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124119147 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124119147 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124119148 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124119148 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124119150 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124119150 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124119150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124119150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:20.109030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22005): Terminating (SIGTERM) 12:41:20.148156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22008): Terminating (SIGTERM) 12:41:20.187532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22011): Terminating (SIGTERM) 12:41:20.227258 --- ParallelTerminationStrategy: PID 22005 died... 12:41:20.246352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22005): Terminated: ok {rc=0} 12:41:20.289799 --- ParallelTerminationStrategy: PID 22008 died... 12:41:20.308178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22008): Terminated: ok {rc=0} 12:41:20.351893 --- ParallelTerminationStrategy: PID 22011 died... 12:41:20.370511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22011): Terminated: ok {rc=0} 12:41:20.455592 bus /sierra_3: Setting Powered False 12:41:21.556666 bus /sierra_3: Setting Powered False 12:41:22.669504 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:41:23.814565 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:23.826612 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:41:23.893424 tst mo_mt_call_osmux.py: using LAC 34014 12:41:24.014681 tst mo_mt_call_osmux.py: using RAC 99 12:41:24.143527 tst mo_mt_call_osmux.py: using CellId 34014 12:41:24.272266 tst mo_mt_call_osmux.py: using BVCI 34015 12:41:24.391261 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:24.403335 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:24.415113 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:24.426691 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:24.438663 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:41:24.450634 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:41:24.567627 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:41:24.687460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:25.160355 run create_hlr_db(pid=22014): Launched 12:41:25.286298 bus /sierra_2: Setting Powered False 12:41:26.346432 run create_hlr_db(pid=22014): Terminated: ok {rc=0} 12:41:26.795083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22016): Launched 12:41:27.123014 run osmo-hlr_10.42.42.2(pid=22017): Launched 12:41:27.247902 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:27.814265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22019): Launched 12:41:28.140790 run osmo-stp_10.42.42.5(pid=22020): Launched 12:41:28.265144 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:28.853800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22022): Launched 12:41:29.180893 run osmo-msc_10.42.42.6(pid=22023): Launched 12:41:29.362778 run osmo-stp_10.42.42.5(pid=22020): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22020)] 12:41:29.501388 run osmo-stp_10.42.42.5(pid=22020): stdout: | (launched: 2022-12-13_12:41:28.080806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:29.639891 run osmo-stp_10.42.42.5(pid=22020): stderr: | 20221213124128273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124128273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124128274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124128274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124128274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124128274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124128275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:29.784111 run osmo-stp_10.42.42.5(pid=22020): stdout: | (launched: 2022-12-13_12:41:28.080806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:29.912362 run osmo-stp_10.42.42.5(pid=22020): stderr: | 20221213124128273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124128273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124128274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124128274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124128274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124128274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124128275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:30.065744 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22020): Process ended prematurely: osmo-stp_10.42.42.5(pid=22020) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22020)] [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:41:30.075858 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:41:30.103802 run osmo-hlr_10.42.42.2(pid=22017): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22017)] 12:41:30.154515 run osmo-hlr_10.42.42.2(pid=22017): stdout: | (launched: 2022-12-13_12:41:27.063158) 12:41:30.206732 run osmo-hlr_10.42.42.2(pid=22017): stderr: | 20221213124127259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124127260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124127260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124127260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124127260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124127260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124127273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124127281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124127282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124127282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:30.279519 run osmo-msc_10.42.42.6(pid=22023): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22023)] 12:41:30.329369 run osmo-msc_10.42.42.6(pid=22023): stdout: | (launched: 2022-12-13_12:41:29.120757) 12:41:30.381344 run osmo-msc_10.42.42.6(pid=22023): stderr: | 20221213124129441 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124129441 DLGLOBAL DEBUG validating counter group 0x7f6d26f23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124129441 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124129441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124129441 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124129441 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124129443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124129444 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124129444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124129444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:30.433562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22016): Terminating (SIGTERM) 12:41:30.475787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22019): Terminating (SIGTERM) 12:41:30.518285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22022): Terminating (SIGTERM) 12:41:30.561061 --- ParallelTerminationStrategy: PID 22016 died... 12:41:30.581701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22016): Terminated: ok {rc=0} 12:41:30.628368 --- ParallelTerminationStrategy: PID 22019 died... 12:41:30.648592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22019): Terminated: ok {rc=0} 12:41:30.695373 --- ParallelTerminationStrategy: PID 22022 died... 12:41:30.715293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22022): Terminated: ok {rc=0} 12:41:30.803250 bus /sierra_3: Setting Powered False 12:41:31.917775 bus /sierra_3: Setting Powered False 12:41:33.048662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:41:34.303949 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:41:34.311655 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:41:34.344350 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:41:34.372785 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:41:34.426345 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:41:34.458233 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:41:34.484768 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:41:35.038612 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:41:35.090554 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:35.102137 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:41:35.170732 tst mo_mt_call.py: using LAC 34015 12:41:35.297368 tst mo_mt_call.py: using RAC 100 12:41:35.424684 tst mo_mt_call.py: using CellId 34015 12:41:35.552746 tst mo_mt_call.py: using BVCI 34016 12:41:35.662779 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:35.674449 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:35.685479 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:35.696410 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:35.707773 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:35.719075 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:41:35.837456 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:41:35.953253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:36.417103 run create_hlr_db(pid=22028): Launched 12:41:36.539118 bus /sierra_2: Setting Powered False 12:41:37.599084 run create_hlr_db(pid=22028): Terminated: ok {rc=0} 12:41:38.037901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22030): Launched 12:41:38.359115 run osmo-hlr_10.42.42.2(pid=22031): Launched 12:41:38.482084 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:39.037608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22033): Launched 12:41:39.360867 run osmo-stp_10.42.42.5(pid=22034): Launched 12:41:39.484378 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:40.067137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22036): Launched 12:41:40.389573 run osmo-msc_10.42.42.6(pid=22037): Launched 12:41:40.571082 run osmo-stp_10.42.42.5(pid=22034): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22034)] 12:41:40.707699 run osmo-stp_10.42.42.5(pid=22034): stdout: | (launched: 2022-12-13_12:41:39.301660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:40.845269 run osmo-stp_10.42.42.5(pid=22034): stderr: | 20221213124139493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124139493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124139493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124139494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124139494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124139494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124139494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:40.980586 run osmo-stp_10.42.42.5(pid=22034): stdout: | (launched: 2022-12-13_12:41:39.301660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:41.109288 run osmo-stp_10.42.42.5(pid=22034): stderr: | 20221213124139493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124139493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124139493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124139494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124139494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124139494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124139494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:41.263108 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22034): Process ended prematurely: osmo-stp_10.42.42.5(pid=22034) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22034)] [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:41:41.272678 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:41:41.300545 run osmo-hlr_10.42.42.2(pid=22031): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22031)] 12:41:41.351041 run osmo-hlr_10.42.42.2(pid=22031): stdout: | (launched: 2022-12-13_12:41:38.300229) 12:41:41.402916 run osmo-hlr_10.42.42.2(pid=22031): stderr: | 20221213124138495 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124138495 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124138495 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124138495 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124138495 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124138495 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124138508 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124138517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124138517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124138517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:41.475466 run osmo-msc_10.42.42.6(pid=22037): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22037)] 12:41:41.525240 run osmo-msc_10.42.42.6(pid=22037): stdout: | (launched: 2022-12-13_12:41:40.330686) 12:41:41.576891 run osmo-msc_10.42.42.6(pid=22037): stderr: | 20221213124140651 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124140651 DLGLOBAL DEBUG validating counter group 0x7f69ea1b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124140651 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124140651 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124140651 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124140651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124140653 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124140654 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124140654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124140654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:41.628549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22030): Terminating (SIGTERM) 12:41:41.670402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22033): Terminating (SIGTERM) 12:41:41.712119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22036): Terminating (SIGTERM) 12:41:41.754771 --- ParallelTerminationStrategy: PID 22030 died... 12:41:41.775094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22030): Terminated: ok {rc=0} 12:41:41.821284 --- ParallelTerminationStrategy: PID 22033 died... 12:41:41.841121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22033): Terminated: ok {rc=0} 12:41:41.887500 --- ParallelTerminationStrategy: PID 22036 died... 12:41:41.907370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22036): Terminated: ok {rc=0} 12:41:41.995357 bus /sierra_3: Setting Powered False 12:41:43.093778 bus /sierra_3: Setting Powered False 12:41:44.210178 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:41:45.358691 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:45.370884 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:41:45.439416 tst mo_mt_call_osmux.py: using LAC 34016 12:41:45.564867 tst mo_mt_call_osmux.py: using RAC 101 12:41:45.690090 tst mo_mt_call_osmux.py: using CellId 34016 12:41:45.818611 tst mo_mt_call_osmux.py: using BVCI 34017 12:41:45.972486 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:45.985612 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:45.998422 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:46.011155 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:46.024684 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:41:46.038167 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:41:46.158891 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:41:46.299940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:46.914549 run create_hlr_db(pid=22039): Launched 12:41:47.070192 bus /sierra_2: Setting Powered False 12:41:48.133978 run create_hlr_db(pid=22039): Terminated: ok {rc=0} 12:41:48.582762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22041): Launched 12:41:48.905105 run osmo-hlr_10.42.42.2(pid=22042): Launched 12:41:49.027269 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:49.584787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22044): Launched 12:41:49.906730 run osmo-stp_10.42.42.5(pid=22045): Launched 12:41:50.029267 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:50.611911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22047): Launched 12:41:50.933628 run osmo-msc_10.42.42.6(pid=22048): Launched 12:41:51.113510 run osmo-stp_10.42.42.5(pid=22045): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22045)] 12:41:51.249938 run osmo-stp_10.42.42.5(pid=22045): stdout: | (launched: 2022-12-13_12:41:49.847715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:51.386684 run osmo-stp_10.42.42.5(pid=22045): stderr: | 20221213124150037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124150037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124150037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124150038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124150038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124150038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124150038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:51.522163 run osmo-stp_10.42.42.5(pid=22045): stdout: | (launched: 2022-12-13_12:41:49.847715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:51.650696 run osmo-stp_10.42.42.5(pid=22045): stderr: | 20221213124150037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124150037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124150037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124150038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124150038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124150038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124150038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:51.804363 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22045): Process ended prematurely: osmo-stp_10.42.42.5(pid=22045) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22045)] [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:41:51.813992 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:41:51.841591 run osmo-hlr_10.42.42.2(pid=22042): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22042)] 12:41:51.891901 run osmo-hlr_10.42.42.2(pid=22042): stdout: | (launched: 2022-12-13_12:41:48.846178) 12:41:51.943319 run osmo-hlr_10.42.42.2(pid=22042): stderr: | 20221213124149042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124149042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124149042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124149042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124149042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124149042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124149055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124149063 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124149063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124149063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:52.015406 run osmo-msc_10.42.42.6(pid=22048): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22048)] 12:41:52.064678 run osmo-msc_10.42.42.6(pid=22048): stdout: | (launched: 2022-12-13_12:41:50.875013) 12:41:52.116140 run osmo-msc_10.42.42.6(pid=22048): stderr: | 20221213124151191 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124151191 DLGLOBAL DEBUG validating counter group 0x7f3c8630dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124151191 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124151191 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124151191 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124151191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124151193 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124151193 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124151194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124151194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:52.167960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22041): Terminating (SIGTERM) 12:41:52.209984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22044): Terminating (SIGTERM) 12:41:52.251537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22047): Terminating (SIGTERM) 12:41:52.294383 --- ParallelTerminationStrategy: PID 22041 died... 12:41:52.314517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22041): Terminated: ok {rc=0} 12:41:52.361188 --- ParallelTerminationStrategy: PID 22044 died... 12:41:52.381122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22044): Terminated: ok {rc=0} 12:41:52.427171 --- ParallelTerminationStrategy: PID 22047 died... 12:41:52.447056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22047): Terminated: ok {rc=0} 12:41:52.535157 bus /sierra_3: Setting Powered False 12:41:53.633681 bus /sierra_3: Setting Powered False 12:41:54.749951 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:41:55.994583 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:41:56.001461 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:41:56.038605 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:41:56.066451 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:41:56.120235 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:41:56.153051 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:41:56.179409 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:41:56.733520 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:41:56.785600 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:41:56.797197 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:41:56.865396 tst mo_mt_call.py: using LAC 34017 12:41:56.991251 tst mo_mt_call.py: using RAC 102 12:41:57.117430 tst mo_mt_call.py: using CellId 34017 12:41:57.244537 tst mo_mt_call.py: using BVCI 34018 12:41:57.362886 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:41:57.374564 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:41:57.386016 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:41:57.397441 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:41:57.409341 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:41:57.421053 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:41:57.535046 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:41:57.657870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:58.154497 run create_hlr_db(pid=22054): Launched 12:41:58.277159 bus /sierra_2: Setting Powered False 12:41:59.337283 run create_hlr_db(pid=22054): Terminated: ok {rc=0} 12:41:59.785635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22056): Launched 12:42:00.107644 run osmo-hlr_10.42.42.2(pid=22057): Launched 12:42:00.229928 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:00.785788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22059): Launched 12:42:01.195711 run osmo-stp_10.42.42.5(pid=22063): Launched 12:42:01.444746 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:02.102690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22065): Launched 12:42:02.437457 run osmo-msc_10.42.42.6(pid=22066): Launched 12:42:02.617981 run osmo-stp_10.42.42.5(pid=22063): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22063)] 12:42:02.754300 run osmo-stp_10.42.42.5(pid=22063): stdout: | (launched: 2022-12-13_12:42:01.121763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:02.890933 run osmo-stp_10.42.42.5(pid=22063): stderr: | 20221213124201404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124201413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124201413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124201414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124201414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124201414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124201414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:03.026840 run osmo-stp_10.42.42.5(pid=22063): stdout: | (launched: 2022-12-13_12:42:01.121763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:03.156025 run osmo-stp_10.42.42.5(pid=22063): stderr: | 20221213124201404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124201413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124201413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124201414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124201414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124201414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124201414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:03.327047 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22063): Process ended prematurely: osmo-stp_10.42.42.5(pid=22063) [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22063)] [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:42:03.336735 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:42:03.364362 run osmo-hlr_10.42.42.2(pid=22057): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22057)] 12:42:03.415812 run osmo-hlr_10.42.42.2(pid=22057): stdout: | (launched: 2022-12-13_12:42:00.048768) 12:42:03.468004 run osmo-hlr_10.42.42.2(pid=22057): stderr: | 20221213124200242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124200242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124200242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124200242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124200242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124200242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124200254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124200263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124200263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124200263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:03.541755 run osmo-msc_10.42.42.6(pid=22066): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22066)] 12:42:03.591468 run osmo-msc_10.42.42.6(pid=22066): stdout: | (launched: 2022-12-13_12:42:02.378441) 12:42:03.643667 run osmo-msc_10.42.42.6(pid=22066): stderr: | 20221213124202698 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124202698 DLGLOBAL DEBUG validating counter group 0x7fbf931abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124202698 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124202698 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124202699 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124202699 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124202700 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124202701 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124202701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124202701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:03.695753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22056): Terminating (SIGTERM) 12:42:03.738418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22059): Terminating (SIGTERM) 12:42:03.780757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22065): Terminating (SIGTERM) 12:42:03.823399 --- ParallelTerminationStrategy: PID 22056 died... 12:42:03.844250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22056): Terminated: ok {rc=0} 12:42:03.891133 --- ParallelTerminationStrategy: PID 22059 died... 12:42:03.911490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22059): Terminated: ok {rc=0} 12:42:03.958151 --- ParallelTerminationStrategy: PID 22065 died... 12:42:03.978511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22065): Terminated: ok {rc=0} 12:42:04.067782 bus /sierra_3: Setting Powered False 12:42:05.166381 bus /sierra_3: Setting Powered False 12:42:06.282128 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:42:07.430479 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:42:07.442835 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:42:07.512811 tst mo_mt_call_osmux.py: using LAC 34018 12:42:07.639950 tst mo_mt_call_osmux.py: using RAC 103 12:42:07.764884 tst mo_mt_call_osmux.py: using CellId 34018 12:42:07.891589 tst mo_mt_call_osmux.py: using BVCI 34019 12:42:08.009810 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:42:08.021532 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:42:08.033086 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:42:08.044558 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:42:08.056420 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:42:08.068251 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:42:08.183862 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:42:08.304226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:08.801795 run create_hlr_db(pid=22068): Launched 12:42:08.924287 bus /sierra_2: Setting Powered False 12:42:09.988361 run create_hlr_db(pid=22068): Terminated: ok {rc=0} 12:42:10.417075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22070): Launched 12:42:10.717577 run osmo-hlr_10.42.42.2(pid=22071): Launched 12:42:10.831257 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:11.353701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22073): Launched 12:42:11.653534 run osmo-stp_10.42.42.5(pid=22074): Launched 12:42:11.767757 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:12.310494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22076): Launched 12:42:12.610964 run osmo-msc_10.42.42.6(pid=22077): Launched 12:42:12.778142 run osmo-stp_10.42.42.5(pid=22074): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22074)] 12:42:12.904811 run osmo-stp_10.42.42.5(pid=22074): stdout: | (launched: 2022-12-13_12:42:11.597521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:13.031005 run osmo-stp_10.42.42.5(pid=22074): stderr: | 20221213124211765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124211765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124211765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124211766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124211766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124211766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124211766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:13.155377 run osmo-stp_10.42.42.5(pid=22074): stdout: | (launched: 2022-12-13_12:42:11.597521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:13.274235 run osmo-stp_10.42.42.5(pid=22074): stderr: | 20221213124211765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124211765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124211765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124211766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124211766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124211766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124211766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:13.416666 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22074): Process ended prematurely: osmo-stp_10.42.42.5(pid=22074) [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22074)] [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:42:13.425714 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:42:13.451799 run osmo-hlr_10.42.42.2(pid=22071): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22071)] 12:42:13.499013 run osmo-hlr_10.42.42.2(pid=22071): stdout: | (launched: 2022-12-13_12:42:10.662076) 12:42:13.547736 run osmo-hlr_10.42.42.2(pid=22071): stderr: | 20221213124210837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124210837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124210837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124210837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124210837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124210837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124210849 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124210858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124210858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124210858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:13.615755 run osmo-msc_10.42.42.6(pid=22077): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22077)] 12:42:13.662613 run osmo-msc_10.42.42.6(pid=22077): stdout: | (launched: 2022-12-13_12:42:12.555505) 12:42:13.711249 run osmo-msc_10.42.42.6(pid=22077): stderr: | 20221213124212825 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124212825 DLGLOBAL DEBUG validating counter group 0x7f0e0736ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124212825 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124212825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124212825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124212826 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124212827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124212828 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124212828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124212828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:13.760090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22070): Terminating (SIGTERM) 12:42:13.799139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22073): Terminating (SIGTERM) 12:42:13.838315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22076): Terminating (SIGTERM) 12:42:13.877829 --- ParallelTerminationStrategy: PID 22070 died... 12:42:13.896467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22070): Terminated: ok {rc=0} 12:42:13.940014 --- ParallelTerminationStrategy: PID 22073 died... 12:42:13.958470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22073): Terminated: ok {rc=0} 12:42:14.001580 --- ParallelTerminationStrategy: PID 22076 died... 12:42:14.019870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22076): Terminated: ok {rc=0} 12:42:14.104475 bus /sierra_3: Setting Powered False 12:42:15.202615 bus /sierra_3: Setting Powered False 12:42:16.324413 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:42:17.578483 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:42:17.586164 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:42:17.619973 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 12:42:17.648164 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 12:42:17.700300 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:42:17.733284 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 12:42:17.761287 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 12:42:18.318944 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 12:42:18.373418 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:18.385172 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:42:18.434989 tst mo_mt_call.py: using LAC 34019 12:42:18.561916 tst mo_mt_call.py: using RAC 104 12:42:18.690755 tst mo_mt_call.py: using CellId 34019 12:42:18.814651 tst mo_mt_call.py: using BVCI 34020 12:42:18.930943 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:18.943046 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:18.954712 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:18.966250 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:18.978256 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:18.990227 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:42:19.105204 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:42:19.220005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:19.685119 run create_hlr_db(pid=22082): Launched 12:42:19.807905 bus /sierra_2: Setting Powered False 12:42:20.868910 run create_hlr_db(pid=22082): Terminated: ok {rc=0} 12:42:21.310630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22084): Launched 12:42:21.633558 run osmo-hlr_10.42.42.2(pid=22085): Launched 12:42:21.758511 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:22.313798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22087): Launched 12:42:22.635796 run osmo-stp_10.42.42.5(pid=22088): Launched 12:42:22.758823 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:23.337247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22090): Launched 12:42:23.657912 run osmo-msc_10.42.42.6(pid=22091): Launched 12:42:23.836351 run osmo-stp_10.42.42.5(pid=22088): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22088)] 12:42:23.971738 run osmo-stp_10.42.42.5(pid=22088): stdout: | (launched: 2022-12-13_12:42:22.576654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:24.107555 run osmo-stp_10.42.42.5(pid=22088): stderr: | 20221213124222766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124222766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124222766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124222767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124222767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124222767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124222767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:24.241325 run osmo-stp_10.42.42.5(pid=22088): stdout: | (launched: 2022-12-13_12:42:22.576654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:24.368572 run osmo-stp_10.42.42.5(pid=22088): stderr: | 20221213124222766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124222766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124222766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124222767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124222767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124222767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124222767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:24.521034 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22088): Process ended prematurely: osmo-stp_10.42.42.5(pid=22088) [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22088)] [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 12:42:24.530930 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:42:24.558637 run osmo-hlr_10.42.42.2(pid=22085): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22085)] 12:42:24.609384 run osmo-hlr_10.42.42.2(pid=22085): stdout: | (launched: 2022-12-13_12:42:21.574662) 12:42:24.660857 run osmo-hlr_10.42.42.2(pid=22085): stderr: | 20221213124221770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124221770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124221770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124221770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124221770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124221771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124221783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124221793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124221793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124221793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:24.733179 run osmo-msc_10.42.42.6(pid=22091): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22091)] 12:42:24.782442 run osmo-msc_10.42.42.6(pid=22091): stdout: | (launched: 2022-12-13_12:42:23.599399) 12:42:24.833897 run osmo-msc_10.42.42.6(pid=22091): stderr: | 20221213124223918 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124223918 DLGLOBAL DEBUG validating counter group 0x7ffbd251bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124223918 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124223918 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124223918 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124223918 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124223920 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124223920 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124223921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124223921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:24.886012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22084): Terminating (SIGTERM) 12:42:24.927529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22087): Terminating (SIGTERM) 12:42:24.969053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22090): Terminating (SIGTERM) 12:42:25.010952 --- ParallelTerminationStrategy: PID 22084 died... 12:42:25.031191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22084): Terminated: ok {rc=0} 12:42:25.077412 --- ParallelTerminationStrategy: PID 22087 died... 12:42:25.097140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22087): Terminated: ok {rc=0} 12:42:25.143201 --- ParallelTerminationStrategy: PID 22090 died... 12:42:25.162982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22090): Terminated: ok {rc=0} 12:42:25.250582 bus /sierra_3: Setting Powered False 12:42:26.349375 bus /sierra_3: Setting Powered False 12:42:27.465315 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 12:42:28.614012 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:28.626368 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:42:28.676641 tst mo_mt_call_osmux.py: using LAC 34020 12:42:28.802310 tst mo_mt_call_osmux.py: using RAC 105 12:42:28.928703 tst mo_mt_call_osmux.py: using CellId 34020 12:42:29.055895 tst mo_mt_call_osmux.py: using BVCI 34021 12:42:29.173494 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:29.185396 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:29.197123 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:29.208725 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:29.221286 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:42:29.233731 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:42:29.354854 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:42:29.471312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:29.933647 run create_hlr_db(pid=22093): Launched 12:42:30.056814 bus /sierra_2: Setting Powered False 12:42:31.115459 run create_hlr_db(pid=22093): Terminated: ok {rc=0} 12:42:31.545381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22095): Launched 12:42:31.869660 run osmo-hlr_10.42.42.2(pid=22096): Launched 12:42:32.116849 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:32.653531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22098): Launched 12:42:32.954807 run osmo-stp_10.42.42.5(pid=22099): Launched 12:42:33.069061 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:33.609644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22101): Launched 12:42:33.911057 run osmo-msc_10.42.42.6(pid=22102): Launched 12:42:34.076883 run osmo-stp_10.42.42.5(pid=22099): ERR: Terminated: ERROR {rc=1} [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22099)] 12:42:34.202586 run osmo-stp_10.42.42.5(pid=22099): stdout: | (launched: 2022-12-13_12:42:32.899110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:34.328689 run osmo-stp_10.42.42.5(pid=22099): stderr: | 20221213124233069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124233069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124233069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124233070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124233070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124233070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124233070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:34.453188 run osmo-stp_10.42.42.5(pid=22099): stdout: | (launched: 2022-12-13_12:42:32.899110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:34.571624 run osmo-stp_10.42.42.5(pid=22099): stderr: | 20221213124233069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124233069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124233069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124233070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124233070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124233070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124233070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:34.714543 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22099): Process ended prematurely: osmo-stp_10.42.42.5(pid=22099) [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22099)] [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 12:42:34.723357 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:42:34.749661 run osmo-hlr_10.42.42.2(pid=22096): ERR: Terminated: ERROR {rc=237} [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22096)] 12:42:34.797059 run osmo-hlr_10.42.42.2(pid=22096): stdout: | (launched: 2022-12-13_12:42:31.804916) 12:42:34.846020 run osmo-hlr_10.42.42.2(pid=22096): stderr: | 20221213124232102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124232102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124232102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124232102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124232102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124232102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124232125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124232138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124232138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124232138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:34.914419 run osmo-msc_10.42.42.6(pid=22102): ERR: Terminated: ERROR {rc=2} [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22102)] 12:42:34.961229 run osmo-msc_10.42.42.6(pid=22102): stdout: | (launched: 2022-12-13_12:42:33.855329) 12:42:35.009782 run osmo-msc_10.42.42.6(pid=22102): stderr: | 20221213124234125 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124234125 DLGLOBAL DEBUG validating counter group 0x7fdbce3e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124234125 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124234125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124234125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124234126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124234127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124234128 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124234128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124234128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:35.059071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22095): Terminating (SIGTERM) 12:42:35.098438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22098): Terminating (SIGTERM) 12:42:35.137648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22101): Terminating (SIGTERM) 12:42:35.176942 --- ParallelTerminationStrategy: PID 22095 died... 12:42:35.195957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22095): Terminated: ok {rc=0} 12:42:35.239395 --- ParallelTerminationStrategy: PID 22098 died... 12:42:35.257863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22098): Terminated: ok {rc=0} 12:42:35.301259 --- ParallelTerminationStrategy: PID 22101 died... 12:42:35.319603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22101): Terminated: ok {rc=0} 12:42:35.404369 bus /sierra_3: Setting Powered False 12:42:36.502792 bus /sierra_3: Setting Powered False 12:42:37.614918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 emergency:nanobts+band-900 --------------------------------------------------------------------- 12:42:38.873844 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:42:38.879469 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:42:38.911929 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:42:38.939744 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 12:42:39.024473 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:42:39.057159 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:42:39.084347 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 12:42:39.672750 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2389 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 12:42:39.678909 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:39.690192 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 12:42:39.737792 tst emergency_mo_mt_call.py: using LAC 34021 12:42:39.861061 tst emergency_mo_mt_call.py: using RAC 106 12:42:39.987520 tst emergency_mo_mt_call.py: using CellId 34021 12:42:40.110789 tst emergency_mo_mt_call.py: using BVCI 34022 12:42:40.225041 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:40.236192 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:40.247100 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:40.258103 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:40.269441 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:40.280595 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:42:40.401004 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:42:40.518783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:41.007212 run create_hlr_db(pid=22107): Launched 12:42:41.133678 bus /sierra_2: Setting Powered False 12:42:42.196847 run create_hlr_db(pid=22107): Terminated: ok {rc=0} 12:42:42.618909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22109): Launched 12:42:42.912117 run osmo-hlr_10.42.42.2(pid=22110): Launched 12:42:43.023102 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:43.539946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22112): Launched 12:42:43.833445 run osmo-stp_10.42.42.5(pid=22113): Launched 12:42:43.955140 tst emergency_mo_mt_call.py: using MSISDN 8156 12:42:44.104360 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:44.634410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22115): Launched 12:42:44.929312 run osmo-msc_10.42.42.6(pid=22116): Launched 12:42:45.093940 run osmo-stp_10.42.42.5(pid=22113): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22113)] 12:42:45.219721 run osmo-stp_10.42.42.5(pid=22113): stdout: | (launched: 2022-12-13_12:42:43.778949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:45.344151 run osmo-stp_10.42.42.5(pid=22113): stderr: | 20221213124243946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124243946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124243946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124243947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124243947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124243947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124243947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:45.466160 run osmo-stp_10.42.42.5(pid=22113): stdout: | (launched: 2022-12-13_12:42:43.778949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:45.582955 run osmo-stp_10.42.42.5(pid=22113): stderr: | 20221213124243946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124243946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124243946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124243947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124243947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124243947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124243947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:45.722653 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22113): Process ended prematurely: osmo-stp_10.42.42.5(pid=22113) [trial-2389↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22113)] [trial-2389↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 12:42:45.731143 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 12:42:45.756823 run osmo-hlr_10.42.42.2(pid=22110): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22110)] 12:42:45.804182 run osmo-hlr_10.42.42.2(pid=22110): stdout: | (launched: 2022-12-13_12:42:42.857658) 12:42:45.862513 run osmo-hlr_10.42.42.2(pid=22110): stderr: | 20221213124243030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124243030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124243030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124243030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124243030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124243030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124243042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124243052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124243052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124243052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:45.950245 run osmo-msc_10.42.42.6(pid=22116): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22116)] 12:42:45.998580 run osmo-msc_10.42.42.6(pid=22116): stdout: | (launched: 2022-12-13_12:42:44.874354) 12:42:46.049560 run osmo-msc_10.42.42.6(pid=22116): stderr: | 20221213124245141 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124245141 DLGLOBAL DEBUG validating counter group 0x7fa109ae9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124245142 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124245142 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124245142 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124245142 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124245144 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124245144 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124245144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124245144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:46.100370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22109): Terminating (SIGTERM) 12:42:46.141465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22112): Terminating (SIGTERM) 12:42:46.183892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22115): Terminating (SIGTERM) 12:42:46.226552 --- ParallelTerminationStrategy: PID 22109 died... 12:42:46.245956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22109): Terminated: ok {rc=0} 12:42:46.292097 --- ParallelTerminationStrategy: PID 22112 died... 12:42:46.311174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22112): Terminated: ok {rc=0} 12:42:46.355408 --- ParallelTerminationStrategy: PID 22115 died... 12:42:46.374532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22115): Terminated: ok {rc=0} 12:42:46.459761 bus /sierra_3: Setting Powered False 12:42:47.554336 bus /sierra_3: Setting Powered False 12:42:48.669584 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 12:42:49.756690 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:49.768099 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 12:42:49.817565 tst emergency_preemptive_call.py: using LAC 34022 12:42:49.942205 tst emergency_preemptive_call.py: using RAC 107 12:42:50.066668 tst emergency_preemptive_call.py: using CellId 34022 12:42:50.189460 tst emergency_preemptive_call.py: using BVCI 34023 12:42:50.305683 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:50.317370 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:50.328528 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:50.339499 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:50.350887 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:42:50.362209 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:42:50.477912 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:42:50.597224 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:42:50.711936 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:42:50.828676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:51.320188 run create_hlr_db(pid=22118): Launched 12:42:51.439958 bus /sierra_2: Setting Powered False 12:42:52.503884 run create_hlr_db(pid=22118): Terminated: ok {rc=0} 12:42:52.946431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22120): Launched 12:42:53.263819 run osmo-hlr_10.42.42.2(pid=22121): Launched 12:42:53.384515 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:53.928044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22123): Launched 12:42:54.244268 run osmo-stp_10.42.42.5(pid=22124): Launched 12:42:54.375049 tst emergency_preemptive_call.py: using MSISDN 8157 12:42:54.536027 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:55.101557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22126): Launched 12:42:55.418361 run osmo-msc_10.42.42.6(pid=22127): Launched 12:42:55.594057 run osmo-stp_10.42.42.5(pid=22124): ERR: Terminated: ERROR {rc=1} [trial-2389↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22124)] 12:42:55.726765 run osmo-stp_10.42.42.5(pid=22124): stdout: | (launched: 2022-12-13_12:42:54.185859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:55.860201 run osmo-stp_10.42.42.5(pid=22124): stderr: | 20221213124254373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124254373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124254373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124254374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124254374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124254374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124254374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:55.993089 run osmo-stp_10.42.42.5(pid=22124): stdout: | (launched: 2022-12-13_12:42:54.185859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:56.119069 run osmo-stp_10.42.42.5(pid=22124): stderr: | 20221213124254373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124254373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124254373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124254374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124254374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124254374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124254374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:56.269372 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22124): Process ended prematurely: osmo-stp_10.42.42.5(pid=22124) [trial-2389↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22124)] [trial-2389↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 12:42:56.278359 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 12:42:56.305788 run osmo-hlr_10.42.42.2(pid=22121): ERR: Terminated: ERROR {rc=237} [trial-2389↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22121)] 12:42:56.356298 run osmo-hlr_10.42.42.2(pid=22121): stdout: | (launched: 2022-12-13_12:42:53.205316) 12:42:56.408271 run osmo-hlr_10.42.42.2(pid=22121): stderr: | 20221213124253397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124253397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124253397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124253397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124253398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124253398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124253411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124253419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124253419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124253419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:56.480878 run osmo-msc_10.42.42.6(pid=22127): ERR: Terminated: ERROR {rc=2} [trial-2389↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22127)] 12:42:56.530573 run osmo-msc_10.42.42.6(pid=22127): stdout: | (launched: 2022-12-13_12:42:55.360032) 12:42:56.582738 run osmo-msc_10.42.42.6(pid=22127): stderr: | 20221213124255679 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124255679 DLGLOBAL DEBUG validating counter group 0x7f0028ca2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124255679 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124255679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124255679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124255680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124255683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124255683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124255683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124255683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:56.635064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22120): Terminating (SIGTERM) 12:42:56.676854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22123): Terminating (SIGTERM) 12:42:56.719406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22126): Terminating (SIGTERM) 12:42:56.761938 --- ParallelTerminationStrategy: PID 22120 died... 12:42:56.782585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22120): Terminated: ok {rc=0} 12:42:56.829321 --- ParallelTerminationStrategy: PID 22123 died... 12:42:56.849371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22123): Terminated: ok {rc=0} 12:42:56.895794 --- ParallelTerminationStrategy: PID 22126 died... 12:42:56.915871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22126): Terminated: ok {rc=0} 12:42:57.003614 bus /sierra_9: Setting Powered False 12:42:58.100473 bus /sierra_9: Setting Powered False 12:42:59.215333 bus /sierra_8: Setting Powered False 12:43:00.312171 bus /sierra_8: Setting Powered False 12:43:01.423289 bus /sierra_3: Setting Powered False 12:43:02.520061 bus /sierra_3: Setting Powered False 12:43:03.635433 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-900 --------------------------------------------------------------------- 12:43:04.909848 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:43:04.914791 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:43:04.946512 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 12:43:04.985051 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 12:43:05.071071 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:43:05.102833 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 12:43:05.140647 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 12:43:05.732303 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 12:43:05.788248 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:05.799534 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:43:05.848780 tst cs_paging_gprs_active.py: using LAC 34023 12:43:05.977139 tst cs_paging_gprs_active.py: using RAC 108 12:43:06.104788 tst cs_paging_gprs_active.py: using CellId 34023 12:43:06.232767 tst cs_paging_gprs_active.py: using BVCI 34024 12:43:06.350273 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:06.361500 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:06.372359 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:06.383248 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:06.394447 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:06.405716 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:06.417166 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:06.428180 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:06.439449 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:43:06.556149 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:43:06.675473 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:43:06.877591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:43:07.179164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22132): Launched 12:43:07.441229 run iperf3-srv_10.42.42.10(pid=22133): Launched 12:43:07.553529 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:43:07.753175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:43:08.053106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22134): Launched 12:43:08.314896 run iperf3-srv_10.42.42.10(pid=22135): Launched 12:43:08.427078 tst cs_paging_gprs_active.py:38: start network... 12:43:08.627484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:43:09.092165 run create_hlr_db(pid=22136): Launched 12:43:09.216545 bus /sierra_2: Setting Powered False 12:43:10.276493 run create_hlr_db(pid=22136): Terminated: ok {rc=0} 12:43:10.694984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22138): Launched 12:43:10.995850 run osmo-hlr_10.42.42.2(pid=22139): Launched 12:43:11.109238 run osmo-stp_10.42.42.5: Starting osmo-stp 12:43:11.624523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22141): Launched 12:43:11.924234 run osmo-stp_10.42.42.5(pid=22142): Launched 12:43:12.037944 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:43:12.555028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22144): Launched 12:43:12.670359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:43:12.924094 run patchelf(pid=22145): Launched 12:43:13.094593 run osmo-stp_10.42.42.5(pid=22142): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22142)] 12:43:13.223713 run osmo-stp_10.42.42.5(pid=22142): stdout: | (launched: 2022-12-13_12:43:11.868508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:13.354782 run osmo-stp_10.42.42.5(pid=22142): stderr: | 20221213124312037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124312037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124312037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124312038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124312038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124312038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124312039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:13.485884 run osmo-stp_10.42.42.5(pid=22142): stdout: | (launched: 2022-12-13_12:43:11.868508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:13.610370 run osmo-stp_10.42.42.5(pid=22142): stderr: | 20221213124312037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124312037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124312037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124312038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124312038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124312038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124312039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:13.758017 run patchelf(pid=22145): Terminating (SIGINT) 12:43:13.929214 run patchelf(pid=22145): Terminated: ok {rc=0} 12:43:14.052171 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22142): Process ended prematurely: osmo-stp_10.42.42.5(pid=22142) [trial-2389↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22142)] [trial-2389↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 12:43:14.061964 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 12:43:14.089193 run osmo-hlr_10.42.42.2(pid=22139): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22139)] 12:43:14.136521 run osmo-hlr_10.42.42.2(pid=22139): stdout: | (launched: 2022-12-13_12:43:10.939893) 12:43:14.185698 run osmo-hlr_10.42.42.2(pid=22139): stderr: | 20221213124311113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124311113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124311113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124311113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124311113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124311113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124311126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124311134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124311135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124311135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:43:14.235119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22132): Terminating (SIGTERM) 12:43:14.274429 run iperf3-srv_10.42.42.10(pid=22133): Terminating (SIGTERM) 12:43:14.313937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22134): Terminating (SIGTERM) 12:43:14.353473 run iperf3-srv_10.42.42.10(pid=22135): Terminating (SIGTERM) 12:43:14.392712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22138): Terminating (SIGTERM) 12:43:14.432161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22141): Terminating (SIGTERM) 12:43:14.471576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22144): Terminating (SIGTERM) 12:43:14.511431 --- ParallelTerminationStrategy: PID 22132 died... 12:43:14.530482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22132): Terminated: ok {rc=0} 12:43:14.574286 --- ParallelTerminationStrategy: PID 22133 died... 12:43:14.592801 run iperf3-srv_10.42.42.10(pid=22133): Terminated {rc=256} 12:43:14.636593 --- ParallelTerminationStrategy: PID 22134 died... 12:43:14.655309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22134): Terminated: ok {rc=0} 12:43:14.698868 --- ParallelTerminationStrategy: PID 22135 died... 12:43:14.717385 run iperf3-srv_10.42.42.10(pid=22135): Terminated {rc=256} 12:43:14.760771 --- ParallelTerminationStrategy: PID 22138 died... 12:43:14.779369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22138): Terminated: ok {rc=0} 12:43:14.822937 --- ParallelTerminationStrategy: PID 22141 died... 12:43:14.841750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22141): Terminated: ok {rc=0} 12:43:14.885345 --- ParallelTerminationStrategy: PID 22144 died... 12:43:14.904005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22144): Terminated: ok {rc=0} 12:43:14.987885 bus /gobi_0: Setting Powered False 12:43:16.084726 bus /gobi_0: Setting Powered False 12:43:17.208928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 12:43:18.358427 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:18.370476 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:43:18.422769 tst iperf3.py: using LAC 34024 12:43:18.546299 tst iperf3.py: using RAC 109 12:43:18.677933 tst iperf3.py: using CellId 34024 12:43:18.805918 tst iperf3.py: using BVCI 34025 12:43:18.917751 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:18.928499 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:18.939132 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:18.949644 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:18.960094 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:18.971430 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:18.985441 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:18.996674 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:19.008276 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:43:19.128262 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:43:19.350178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:43:19.679563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22146): Launched 12:43:19.966886 run iperf3-srv_10.42.42.10(pid=22147): Launched 12:43:20.089473 tst iperf3.py:8: start network... 12:43:20.310519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:43:20.816893 run create_hlr_db(pid=22148): Launched 12:43:20.941780 bus /gobi_6: Setting Powered False 12:43:22.006529 run create_hlr_db(pid=22148): Terminated: ok {rc=0} 12:43:22.442525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22150): Launched 12:43:22.748142 run osmo-hlr_10.42.42.2(pid=22151): Launched 12:43:22.864199 run osmo-stp_10.42.42.5: Starting osmo-stp 12:43:23.407146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22153): Launched 12:43:23.714307 run osmo-stp_10.42.42.5(pid=22154): Launched 12:43:23.829777 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:43:24.353560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22156): Launched 12:43:24.472348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:43:24.730552 run patchelf(pid=22157): Launched 12:43:24.899979 run osmo-stp_10.42.42.5(pid=22154): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22154)] 12:43:25.029208 run osmo-stp_10.42.42.5(pid=22154): stdout: | (launched: 2022-12-13_12:43:23.658174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:25.159975 run osmo-stp_10.42.42.5(pid=22154): stderr: | 20221213124323827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124323827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124323827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124323828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124323828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124323828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124323828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:25.290776 run osmo-stp_10.42.42.5(pid=22154): stdout: | (launched: 2022-12-13_12:43:23.658174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:25.415458 run osmo-stp_10.42.42.5(pid=22154): stderr: | 20221213124323827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124323827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124323827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124323828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124323828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124323828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124323828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:25.563970 run patchelf(pid=22157): Terminating (SIGINT) 12:43:25.734625 run patchelf(pid=22157): Terminated: ok {rc=0} 12:43:25.857629 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22154): Process ended prematurely: osmo-stp_10.42.42.5(pid=22154) [trial-2389↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22154)] [trial-2389↪gprs:nanobts+band-900↪iperf3.py:8] 12:43:25.867244 tst iperf3.py:8: Test FAILED (7.5 sec) 12:43:25.894575 run osmo-hlr_10.42.42.2(pid=22151): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22151)] 12:43:25.941997 run osmo-hlr_10.42.42.2(pid=22151): stdout: | (launched: 2022-12-13_12:43:22.691928) 12:43:25.991360 run osmo-hlr_10.42.42.2(pid=22151): stderr: | 20221213124322869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124322869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124322869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124322869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124322869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124322869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124322882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124322892 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124322892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124322892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:43:26.041038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22146): Terminating (SIGTERM) 12:43:26.080744 run iperf3-srv_10.42.42.10(pid=22147): Terminating (SIGTERM) 12:43:26.120576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22150): Terminating (SIGTERM) 12:43:26.160600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22153): Terminating (SIGTERM) 12:43:26.200229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22156): Terminating (SIGTERM) 12:43:26.240290 --- ParallelTerminationStrategy: PID 22146 died... 12:43:26.259305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22146): Terminated: ok {rc=0} 12:43:26.303413 --- ParallelTerminationStrategy: PID 22147 died... 12:43:26.321924 run iperf3-srv_10.42.42.10(pid=22147): Terminated {rc=256} 12:43:26.365461 --- ParallelTerminationStrategy: PID 22150 died... 12:43:26.383877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22150): Terminated: ok {rc=0} 12:43:26.427784 --- ParallelTerminationStrategy: PID 22153 died... 12:43:26.446497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22153): Terminated: ok {rc=0} 12:43:26.490213 --- ParallelTerminationStrategy: PID 22156 died... 12:43:26.508765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22156): Terminated: ok {rc=0} 12:43:26.593927 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 12:43:27.744887 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:27.756747 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:43:27.807960 tst iperf3m4.py: using LAC 34025 12:43:27.932017 tst iperf3m4.py: using RAC 110 12:43:28.051511 tst iperf3m4.py: using CellId 34025 12:43:28.169374 tst iperf3m4.py: using BVCI 34026 12:43:28.279210 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:28.290222 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:28.301028 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:28.311648 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:28.322220 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:28.332778 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:28.344020 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:28.355033 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:28.365843 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:43:28.481031 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:43:28.602455 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:43:28.724112 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:43:28.844654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:43:29.066994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:43:29.396084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22158): Launched 12:43:29.682355 run iperf3-srv_10.42.42.10(pid=22159): Launched 12:43:29.804840 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:43:30.025717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:43:30.354430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22160): Launched 12:43:30.641084 run iperf3-srv_10.42.42.10(pid=22161): Launched 12:43:30.763565 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:43:31.037388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:43:31.409196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22162): Launched 12:43:31.708724 run iperf3-srv_10.42.42.10(pid=22163): Launched 12:43:31.862821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:43:32.091182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:43:32.423462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22164): Launched 12:43:32.709475 run iperf3-srv_10.42.42.10(pid=22165): Launched 12:43:32.832546 tst iperf3m4.py:8: start network... 12:43:33.054781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:43:33.563824 run create_hlr_db(pid=22166): Launched 12:43:33.688275 bus /gobi_6: Setting Powered False 12:43:34.753041 run create_hlr_db(pid=22166): Terminated: ok {rc=0} 12:43:35.208576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22168): Launched 12:43:35.537334 run osmo-hlr_10.42.42.2(pid=22169): Launched 12:43:35.663180 run osmo-stp_10.42.42.5: Starting osmo-stp 12:43:36.226189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22171): Launched 12:43:36.555550 run osmo-stp_10.42.42.5(pid=22172): Launched 12:43:36.681742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:43:37.246632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22174): Launched 12:43:37.372596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:43:37.650861 run patchelf(pid=22175): Launched 12:43:37.834403 run osmo-stp_10.42.42.5(pid=22172): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22172)] 12:43:37.973478 run osmo-stp_10.42.42.5(pid=22172): stdout: | (launched: 2022-12-13_12:43:36.495226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:38.114172 run osmo-stp_10.42.42.5(pid=22172): stderr: | 20221213124336684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124336684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124336684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124336685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124336685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124336685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124336685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:38.255645 run osmo-stp_10.42.42.5(pid=22172): stdout: | (launched: 2022-12-13_12:43:36.495226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:38.390088 run osmo-stp_10.42.42.5(pid=22172): stderr: | 20221213124336684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124336684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124336684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124336685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124336685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124336685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124336685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:38.549614 run patchelf(pid=22175): Terminating (SIGINT) 12:43:38.733749 run patchelf(pid=22175): Terminated: ok {rc=0} 12:43:38.866572 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22172): Process ended prematurely: osmo-stp_10.42.42.5(pid=22172) [trial-2389↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22172)] [trial-2389↪gprs:nanobts+band-900↪iperf3m4.py:8] 12:43:38.876940 tst iperf3m4.py:8: Test FAILED (11.2 sec) 12:43:38.905776 run osmo-hlr_10.42.42.2(pid=22169): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22169)] 12:43:38.956354 run osmo-hlr_10.42.42.2(pid=22169): stdout: | (launched: 2022-12-13_12:43:35.476915) 12:43:39.008645 run osmo-hlr_10.42.42.2(pid=22169): stderr: | 20221213124335673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124335673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124335673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124335673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124335673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124335673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124335732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124335741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124335742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124335742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:43:39.061183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22158): Terminating (SIGTERM) 12:43:39.103236 run iperf3-srv_10.42.42.10(pid=22159): Terminating (SIGTERM) 12:43:39.145957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22160): Terminating (SIGTERM) 12:43:39.188164 run iperf3-srv_10.42.42.10(pid=22161): Terminating (SIGTERM) 12:43:39.230191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22162): Terminating (SIGTERM) 12:43:39.272588 run iperf3-srv_10.42.42.10(pid=22163): Terminating (SIGTERM) 12:43:39.314432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22164): Terminating (SIGTERM) 12:43:39.356305 run iperf3-srv_10.42.42.10(pid=22165): Terminating (SIGTERM) 12:43:39.398258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22168): Terminating (SIGTERM) 12:43:39.440170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22171): Terminating (SIGTERM) 12:43:39.481853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22174): Terminating (SIGTERM) 12:43:39.523871 --- ParallelTerminationStrategy: PID 22158 died... 12:43:39.544497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22158): Terminated: ok {rc=0} 12:43:39.591504 --- ParallelTerminationStrategy: PID 22159 died... 12:43:39.611445 run iperf3-srv_10.42.42.10(pid=22159): Terminated {rc=256} 12:43:39.657705 --- ParallelTerminationStrategy: PID 22160 died... 12:43:39.677520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22160): Terminated: ok {rc=0} 12:43:39.724047 --- ParallelTerminationStrategy: PID 22161 died... 12:43:39.744229 run iperf3-srv_10.42.42.10(pid=22161): Terminated {rc=256} 12:43:39.791158 --- ParallelTerminationStrategy: PID 22162 died... 12:43:39.811358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22162): Terminated: ok {rc=0} 12:43:39.857948 --- ParallelTerminationStrategy: PID 22163 died... 12:43:39.877923 run iperf3-srv_10.42.42.10(pid=22163): Terminated {rc=256} 12:43:39.924372 --- ParallelTerminationStrategy: PID 22164 died... 12:43:39.944450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22164): Terminated: ok {rc=0} 12:43:39.991075 --- ParallelTerminationStrategy: PID 22165 died... 12:43:40.011129 run iperf3-srv_10.42.42.10(pid=22165): Terminated {rc=256} 12:43:40.057571 --- ParallelTerminationStrategy: PID 22168 died... 12:43:40.077605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22168): Terminated: ok {rc=0} 12:43:40.124102 --- ParallelTerminationStrategy: PID 22171 died... 12:43:40.144135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22171): Terminated: ok {rc=0} 12:43:40.190702 --- ParallelTerminationStrategy: PID 22174 died... 12:43:40.210945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22174): Terminated: ok {rc=0} 12:43:40.299376 bus /gobi_4: Setting Powered False 12:43:41.398569 bus /gobi_4: Setting Powered False 12:43:42.514883 bus /gobi_1: Setting Powered False 12:43:43.613685 bus /gobi_1: Setting Powered False 12:43:44.729864 bus /gobi_0: Setting Powered False 12:43:45.828220 bus /gobi_0: Setting Powered False 12:43:46.955780 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900 ping.py ---------------------------------------------- 12:43:48.074886 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:48.086250 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:43:48.134508 tst ping.py: using LAC 34026 12:43:48.253480 tst ping.py: using RAC 111 12:43:48.372122 tst ping.py: using CellId 34026 12:43:48.490599 tst ping.py: using BVCI 34027 12:43:48.601049 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:48.611816 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:48.622454 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:48.632900 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:48.643450 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:48.653922 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:48.665112 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:48.675908 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:43:48.790694 tst ping.py:19: start network... 12:43:48.993035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:43:49.487177 run create_hlr_db(pid=22176): Launched 12:43:49.611863 bus /gobi_6: Setting Powered False 12:43:50.675968 run create_hlr_db(pid=22176): Terminated: ok {rc=0} 12:43:51.106372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22178): Launched 12:43:51.410036 run osmo-hlr_10.42.42.2(pid=22179): Launched 12:43:51.524150 run osmo-stp_10.42.42.5: Starting osmo-stp 12:43:52.047172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22181): Launched 12:43:52.347445 run osmo-stp_10.42.42.5(pid=22182): Launched 12:43:52.460702 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:43:52.978473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22184): Launched 12:43:53.094479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:43:53.347015 run patchelf(pid=22185): Launched 12:43:53.515764 run osmo-stp_10.42.42.5(pid=22182): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22182)] 12:43:53.643258 run osmo-stp_10.42.42.5(pid=22182): stdout: | (launched: 2022-12-13_12:43:52.290877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:53.772242 run osmo-stp_10.42.42.5(pid=22182): stderr: | 20221213124352461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124352461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124352462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124352462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124352462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124352463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124352463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:53.901460 run osmo-stp_10.42.42.5(pid=22182): stdout: | (launched: 2022-12-13_12:43:52.290877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:54.024114 run osmo-stp_10.42.42.5(pid=22182): stderr: | 20221213124352461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124352461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124352462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124352462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124352462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124352463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124352463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:54.170483 run patchelf(pid=22185): Terminating (SIGINT) 12:43:54.338607 run patchelf(pid=22185): Terminated: ok {rc=0} 12:43:54.460024 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22182): Process ended prematurely: osmo-stp_10.42.42.5(pid=22182) [trial-2389↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22182)] [trial-2389↪gprs:nanobts+band-900↪ping.py:22] 12:43:54.469191 tst ping.py:22: Test FAILED (6.4 sec) 12:43:54.495965 run osmo-hlr_10.42.42.2(pid=22179): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22179)] 12:43:54.543201 run osmo-hlr_10.42.42.2(pid=22179): stdout: | (launched: 2022-12-13_12:43:51.352929) 12:43:54.592262 run osmo-hlr_10.42.42.2(pid=22179): stderr: | 20221213124351528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124351528 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124351528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124351528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124351528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124351528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124351541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124351551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124351551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124351551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:43:54.641731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22178): Terminating (SIGTERM) 12:43:54.680846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22181): Terminating (SIGTERM) 12:43:54.719995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22184): Terminating (SIGTERM) 12:43:54.759564 --- ParallelTerminationStrategy: PID 22178 died... 12:43:54.778488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22178): Terminated: ok {rc=0} 12:43:54.821952 --- ParallelTerminationStrategy: PID 22181 died... 12:43:54.840404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22181): Terminated: ok {rc=0} 12:43:54.884114 --- ParallelTerminationStrategy: PID 22184 died... 12:43:54.902622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22184): Terminated: ok {rc=0} 12:43:54.988124 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 12:43:56.076536 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:56.088072 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:43:56.136847 tst ping_idle_ping.py: using LAC 34027 12:43:56.257050 tst ping_idle_ping.py: using RAC 112 12:43:56.375112 tst ping_idle_ping.py: using CellId 34027 12:43:56.494773 tst ping_idle_ping.py: using BVCI 34028 12:43:56.604187 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:56.615072 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:56.625706 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:56.636143 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:56.646745 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:56.657885 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:56.669730 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:43:56.680789 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:43:56.801703 tst ping_idle_ping.py:24: start network... 12:43:57.020588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:43:57.522353 run create_hlr_db(pid=22186): Launched 12:43:57.648466 bus /gobi_6: Setting Powered False 12:43:58.713072 run create_hlr_db(pid=22186): Terminated: ok {rc=0} 12:43:59.144741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22188): Launched 12:43:59.446679 run osmo-hlr_10.42.42.2(pid=22189): Launched 12:43:59.562100 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:00.082661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22191): Launched 12:44:00.385725 run osmo-stp_10.42.42.5(pid=22192): Launched 12:44:00.500818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:44:01.053124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22194): Launched 12:44:01.184326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:44:01.465693 run patchelf(pid=22195): Launched 12:44:01.662926 run osmo-stp_10.42.42.5(pid=22192): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22192)] 12:44:01.805738 run osmo-stp_10.42.42.5(pid=22192): stdout: | (launched: 2022-12-13_12:44:00.329734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:01.949789 run osmo-stp_10.42.42.5(pid=22192): stderr: | 20221213124400502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124400502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124400502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124400503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124400503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124400503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124400503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:02.103712 run osmo-stp_10.42.42.5(pid=22192): stdout: | (launched: 2022-12-13_12:44:00.329734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:02.228158 run osmo-stp_10.42.42.5(pid=22192): stderr: | 20221213124400502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124400502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124400502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124400503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124400503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124400503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124400503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:02.373981 run patchelf(pid=22195): Terminating (SIGINT) 12:44:02.543054 run patchelf(pid=22195): Terminated: ok {rc=0} 12:44:02.664859 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22192): Process ended prematurely: osmo-stp_10.42.42.5(pid=22192) [trial-2389↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22192)] [trial-2389↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 12:44:02.673956 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:44:02.701174 run osmo-hlr_10.42.42.2(pid=22189): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22189)] 12:44:02.749435 run osmo-hlr_10.42.42.2(pid=22189): stdout: | (launched: 2022-12-13_12:43:59.390654) 12:44:02.799173 run osmo-hlr_10.42.42.2(pid=22189): stderr: | 20221213124359564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124359564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124359564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124359564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124359564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124359564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124359577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124359586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124359586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124359586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:02.849853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22188): Terminating (SIGTERM) 12:44:02.890147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22191): Terminating (SIGTERM) 12:44:02.930336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22194): Terminating (SIGTERM) 12:44:02.970890 --- ParallelTerminationStrategy: PID 22188 died... 12:44:02.990299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22188): Terminated: ok {rc=0} 12:44:03.034965 --- ParallelTerminationStrategy: PID 22191 died... 12:44:03.053988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22191): Terminated: ok {rc=0} 12:44:03.098580 --- ParallelTerminationStrategy: PID 22194 died... 12:44:03.117610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22194): Terminated: ok {rc=0} 12:44:03.201920 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 12:44:04.509150 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:04.516258 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:44:04.550632 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:44:04.591591 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:44:04.681777 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:44:04.715153 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:44:04.755338 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:44:05.357750 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:44:05.411310 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:05.422979 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:44:05.477931 tst cs_paging_gprs_active.py: using LAC 34028 12:44:05.598693 tst cs_paging_gprs_active.py: using RAC 113 12:44:05.718615 tst cs_paging_gprs_active.py: using CellId 34028 12:44:05.839801 tst cs_paging_gprs_active.py: using BVCI 34029 12:44:05.950522 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:05.961606 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:05.972601 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:05.983375 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:05.994137 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:06.004907 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:06.015803 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:06.026544 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:06.037494 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:44:06.157508 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:44:06.278362 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:44:06.500467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:44:06.831263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22199): Launched 12:44:07.119350 run iperf3-srv_10.42.42.10(pid=22200): Launched 12:44:07.244081 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:44:07.465128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:44:07.795652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22201): Launched 12:44:08.082258 run iperf3-srv_10.42.42.10(pid=22202): Launched 12:44:08.204629 tst cs_paging_gprs_active.py:38: start network... 12:44:08.425054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:08.933322 run create_hlr_db(pid=22203): Launched 12:44:09.060886 bus /gobi_6: Setting Powered False 12:44:10.125338 run create_hlr_db(pid=22203): Terminated: ok {rc=0} 12:44:10.581841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22205): Launched 12:44:10.911012 run osmo-hlr_10.42.42.2(pid=22206): Launched 12:44:11.038190 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:11.605505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22208): Launched 12:44:11.941777 run osmo-stp_10.42.42.5(pid=22209): Launched 12:44:12.063805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:44:12.604829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22211): Launched 12:44:12.722787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:44:12.981610 run patchelf(pid=22212): Launched 12:44:13.153265 run osmo-stp_10.42.42.5(pid=22209): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22209)] 12:44:13.283132 run osmo-stp_10.42.42.5(pid=22209): stdout: | (launched: 2022-12-13_12:44:11.875254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:13.414973 run osmo-stp_10.42.42.5(pid=22209): stderr: | 20221213124412057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124412057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124412057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124412058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124412058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124412058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124412058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:13.547259 run osmo-stp_10.42.42.5(pid=22209): stdout: | (launched: 2022-12-13_12:44:11.875254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:13.673121 run osmo-stp_10.42.42.5(pid=22209): stderr: | 20221213124412057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124412057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124412057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124412058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124412058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124412058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124412058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:13.822091 run patchelf(pid=22212): Terminating (SIGINT) 12:44:13.995540 run patchelf(pid=22212): Terminated: ok {rc=0} 12:44:14.119558 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22209): Process ended prematurely: osmo-stp_10.42.42.5(pid=22209) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22209)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:44:14.129198 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:44:14.156399 run osmo-hlr_10.42.42.2(pid=22206): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22206)] 12:44:14.203910 run osmo-hlr_10.42.42.2(pid=22206): stdout: | (launched: 2022-12-13_12:44:10.850825) 12:44:14.253360 run osmo-hlr_10.42.42.2(pid=22206): stderr: | 20221213124411048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124411048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124411048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124411049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124411049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124411049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124411061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124411069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124411069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124411070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:14.302906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22199): Terminating (SIGTERM) 12:44:14.342789 run iperf3-srv_10.42.42.10(pid=22200): Terminating (SIGTERM) 12:44:14.382181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22201): Terminating (SIGTERM) 12:44:14.421799 run iperf3-srv_10.42.42.10(pid=22202): Terminating (SIGTERM) 12:44:14.461300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22205): Terminating (SIGTERM) 12:44:14.501750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22208): Terminating (SIGTERM) 12:44:14.541549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22211): Terminating (SIGTERM) 12:44:14.581462 --- ParallelTerminationStrategy: PID 22199 died... 12:44:14.600550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22199): Terminated: ok {rc=0} 12:44:14.644820 --- ParallelTerminationStrategy: PID 22200 died... 12:44:14.663912 run iperf3-srv_10.42.42.10(pid=22200): Terminated {rc=256} 12:44:14.707545 --- ParallelTerminationStrategy: PID 22201 died... 12:44:14.726444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22201): Terminated: ok {rc=0} 12:44:14.770202 --- ParallelTerminationStrategy: PID 22202 died... 12:44:14.788823 run iperf3-srv_10.42.42.10(pid=22202): Terminated {rc=256} 12:44:14.832391 --- ParallelTerminationStrategy: PID 22205 died... 12:44:14.851182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22205): Terminated: ok {rc=0} 12:44:14.894814 --- ParallelTerminationStrategy: PID 22208 died... 12:44:14.913592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22208): Terminated: ok {rc=0} 12:44:14.957369 --- ParallelTerminationStrategy: PID 22211 died... 12:44:14.975775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22211): Terminated: ok {rc=0} 12:44:15.059607 bus /gobi_0: Setting Powered False 12:44:16.158970 bus /gobi_0: Setting Powered False 12:44:17.274846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:44:18.425344 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:18.437494 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:44:18.492034 tst iperf3.py: using LAC 34029 12:44:18.622514 tst iperf3.py: using RAC 114 12:44:18.752844 tst iperf3.py: using CellId 34029 12:44:18.881423 tst iperf3.py: using BVCI 34030 12:44:19.001909 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:19.013544 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:19.024765 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:19.036160 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:19.047372 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:19.058941 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:19.071253 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:19.082771 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:19.094502 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:44:19.214171 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:44:19.437324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:44:19.769555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22213): Launched 12:44:20.060079 run iperf3-srv_10.42.42.10(pid=22214): Launched 12:44:20.185393 tst iperf3.py:8: start network... 12:44:20.408097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:20.918046 run create_hlr_db(pid=22215): Launched 12:44:21.042846 bus /gobi_6: Setting Powered False 12:44:22.107360 run create_hlr_db(pid=22215): Terminated: ok {rc=0} 12:44:22.545062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22217): Launched 12:44:22.852134 run osmo-hlr_10.42.42.2(pid=22218): Launched 12:44:22.969293 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:23.497080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22220): Launched 12:44:23.803049 run osmo-stp_10.42.42.5(pid=22221): Launched 12:44:23.919949 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:44:24.447171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22223): Launched 12:44:24.564607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:44:24.823516 run patchelf(pid=22224): Launched 12:44:24.994176 run osmo-stp_10.42.42.5(pid=22221): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22221)] 12:44:25.124226 run osmo-stp_10.42.42.5(pid=22221): stdout: | (launched: 2022-12-13_12:44:23.746427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:25.255432 run osmo-stp_10.42.42.5(pid=22221): stderr: | 20221213124423915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124423915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124423915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124423916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124423916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124423916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124423916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:25.386849 run osmo-stp_10.42.42.5(pid=22221): stdout: | (launched: 2022-12-13_12:44:23.746427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:25.511665 run osmo-stp_10.42.42.5(pid=22221): stderr: | 20221213124423915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124423915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124423915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124423916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124423916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124423916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124423916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:25.660406 run patchelf(pid=22224): Terminating (SIGINT) 12:44:25.831723 run patchelf(pid=22224): Terminated: ok {rc=0} 12:44:25.955621 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22221): Process ended prematurely: osmo-stp_10.42.42.5(pid=22221) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22221)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 12:44:25.965357 tst iperf3.py:8: Test FAILED (7.6 sec) 12:44:25.992934 run osmo-hlr_10.42.42.2(pid=22218): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22218)] 12:44:26.041280 run osmo-hlr_10.42.42.2(pid=22218): stdout: | (launched: 2022-12-13_12:44:22.795413) 12:44:26.090935 run osmo-hlr_10.42.42.2(pid=22218): stderr: | 20221213124422973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124422973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124422973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124422973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124422973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124422973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124422985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124422994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124422994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124422994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:26.140814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22213): Terminating (SIGTERM) 12:44:26.180636 run iperf3-srv_10.42.42.10(pid=22214): Terminating (SIGTERM) 12:44:26.220315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22217): Terminating (SIGTERM) 12:44:26.260025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22220): Terminating (SIGTERM) 12:44:26.299603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22223): Terminating (SIGTERM) 12:44:26.339800 --- ParallelTerminationStrategy: PID 22213 died... 12:44:26.359200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22213): Terminated: ok {rc=0} 12:44:26.403666 --- ParallelTerminationStrategy: PID 22214 died... 12:44:26.422825 run iperf3-srv_10.42.42.10(pid=22214): Terminated {rc=256} 12:44:26.466990 --- ParallelTerminationStrategy: PID 22217 died... 12:44:26.486246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22217): Terminated: ok {rc=0} 12:44:26.530791 --- ParallelTerminationStrategy: PID 22220 died... 12:44:26.550028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22220): Terminated: ok {rc=0} 12:44:26.594312 --- ParallelTerminationStrategy: PID 22223 died... 12:44:26.613320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22223): Terminated: ok {rc=0} 12:44:26.699794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:44:27.848705 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:27.860677 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:44:27.911520 tst iperf3m4.py: using LAC 34030 12:44:28.041498 tst iperf3m4.py: using RAC 115 12:44:28.162319 tst iperf3m4.py: using CellId 34030 12:44:28.282862 tst iperf3m4.py: using BVCI 34031 12:44:28.395189 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:28.406325 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:28.417247 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:28.428005 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:28.438996 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:28.450099 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:28.461214 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:28.472165 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:28.483311 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:44:28.605268 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:44:28.726842 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:44:28.845319 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:44:28.966522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:44:29.190535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:44:29.521681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22226): Launched 12:44:29.811169 run iperf3-srv_10.42.42.10(pid=22227): Launched 12:44:29.927306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:44:30.135195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:44:30.444848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22228): Launched 12:44:30.713392 run iperf3-srv_10.42.42.10(pid=22229): Launched 12:44:30.828631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:44:31.069455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:44:31.413677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22230): Launched 12:44:31.723264 run iperf3-srv_10.42.42.10(pid=22231): Launched 12:44:31.855292 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:44:32.066151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:44:32.377055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22232): Launched 12:44:32.645720 run iperf3-srv_10.42.42.10(pid=22233): Launched 12:44:32.762579 tst iperf3m4.py:8: start network... 12:44:32.969891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:33.447310 run create_hlr_db(pid=22234): Launched 12:44:33.573497 bus /gobi_6: Setting Powered False 12:44:34.634584 run create_hlr_db(pid=22234): Terminated: ok {rc=0} 12:44:35.062432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22236): Launched 12:44:35.371290 run osmo-hlr_10.42.42.2(pid=22237): Launched 12:44:35.489020 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:36.016130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22239): Launched 12:44:36.324174 run osmo-stp_10.42.42.5(pid=22240): Launched 12:44:36.441421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:44:36.967720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22242): Launched 12:44:37.084781 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:44:37.344652 run patchelf(pid=22243): Launched 12:44:37.516003 run osmo-stp_10.42.42.5(pid=22240): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22240)] 12:44:37.645855 run osmo-stp_10.42.42.5(pid=22240): stdout: | (launched: 2022-12-13_12:44:36.266975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:37.777115 run osmo-stp_10.42.42.5(pid=22240): stderr: | 20221213124436437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124436438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124436438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124436438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124436439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124436439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124436439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:37.908562 run osmo-stp_10.42.42.5(pid=22240): stdout: | (launched: 2022-12-13_12:44:36.266975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:38.033969 run osmo-stp_10.42.42.5(pid=22240): stderr: | 20221213124436437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124436438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124436438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124436438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124436439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124436439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124436439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:38.182589 run patchelf(pid=22243): Terminating (SIGINT) 12:44:38.353713 run patchelf(pid=22243): Terminated: ok {rc=0} 12:44:38.477300 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22240): Process ended prematurely: osmo-stp_10.42.42.5(pid=22240) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22240)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 12:44:38.486821 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:44:38.514543 run osmo-hlr_10.42.42.2(pid=22237): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22237)] 12:44:38.562055 run osmo-hlr_10.42.42.2(pid=22237): stdout: | (launched: 2022-12-13_12:44:35.314038) 12:44:38.611645 run osmo-hlr_10.42.42.2(pid=22237): stderr: | 20221213124435489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124435489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124435489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124435489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124435489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124435489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124435501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124435509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124435509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124435510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:38.661387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22226): Terminating (SIGTERM) 12:44:38.701240 run iperf3-srv_10.42.42.10(pid=22227): Terminating (SIGTERM) 12:44:38.741130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22228): Terminating (SIGTERM) 12:44:38.780820 run iperf3-srv_10.42.42.10(pid=22229): Terminating (SIGTERM) 12:44:38.820425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22230): Terminating (SIGTERM) 12:44:38.860042 run iperf3-srv_10.42.42.10(pid=22231): Terminating (SIGTERM) 12:44:38.899355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22232): Terminating (SIGTERM) 12:44:38.938875 run iperf3-srv_10.42.42.10(pid=22233): Terminating (SIGTERM) 12:44:38.978331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22236): Terminating (SIGTERM) 12:44:39.017957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22239): Terminating (SIGTERM) 12:44:39.057473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22242): Terminating (SIGTERM) 12:44:39.097486 --- ParallelTerminationStrategy: PID 22226 died... 12:44:39.116740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22226): Terminated: ok {rc=0} 12:44:39.161180 --- ParallelTerminationStrategy: PID 22227 died... 12:44:39.179734 run iperf3-srv_10.42.42.10(pid=22227): Terminated {rc=256} 12:44:39.223562 --- ParallelTerminationStrategy: PID 22228 died... 12:44:39.242371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22228): Terminated: ok {rc=0} 12:44:39.286361 --- ParallelTerminationStrategy: PID 22229 died... 12:44:39.305071 run iperf3-srv_10.42.42.10(pid=22229): Terminated {rc=256} 12:44:39.348933 --- ParallelTerminationStrategy: PID 22230 died... 12:44:39.367995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22230): Terminated: ok {rc=0} 12:44:39.411680 --- ParallelTerminationStrategy: PID 22231 died... 12:44:39.430451 run iperf3-srv_10.42.42.10(pid=22231): Terminated {rc=256} 12:44:39.474218 --- ParallelTerminationStrategy: PID 22232 died... 12:44:39.492671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22232): Terminated: ok {rc=0} 12:44:39.536640 --- ParallelTerminationStrategy: PID 22233 died... 12:44:39.555569 run iperf3-srv_10.42.42.10(pid=22233): Terminated {rc=256} 12:44:39.599864 --- ParallelTerminationStrategy: PID 22236 died... 12:44:39.618631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22236): Terminated: ok {rc=0} 12:44:39.662549 --- ParallelTerminationStrategy: PID 22239 died... 12:44:39.681940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22239): Terminated: ok {rc=0} 12:44:39.726010 --- ParallelTerminationStrategy: PID 22242 died... 12:44:39.744995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22242): Terminated: ok {rc=0} 12:44:39.831044 bus /gobi_4: Setting Powered False 12:44:40.930271 bus /gobi_4: Setting Powered False 12:44:42.044003 bus /gobi_1: Setting Powered False 12:44:43.143713 bus /gobi_1: Setting Powered False 12:44:44.256216 bus /gobi_0: Setting Powered False 12:44:45.353624 bus /gobi_0: Setting Powered False 12:44:46.469729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 12:44:47.570404 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:47.582299 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:44:47.633404 tst ping.py: using LAC 34031 12:44:47.752720 tst ping.py: using RAC 116 12:44:47.871195 tst ping.py: using CellId 34031 12:44:47.990542 tst ping.py: using BVCI 34032 12:44:48.101301 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:48.112784 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:48.124019 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:48.134993 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:48.146038 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:48.157015 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:48.168122 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:48.179150 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:44:48.293409 tst ping.py:19: start network... 12:44:48.494208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:48.961014 run create_hlr_db(pid=22244): Launched 12:44:49.084885 bus /gobi_6: Setting Powered False 12:44:50.146342 run create_hlr_db(pid=22244): Terminated: ok {rc=0} 12:44:50.589752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22246): Launched 12:44:50.913792 run osmo-hlr_10.42.42.2(pid=22247): Launched 12:44:51.039401 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:51.600241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22249): Launched 12:44:51.925589 run osmo-stp_10.42.42.5(pid=22250): Launched 12:44:52.048706 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:44:52.607997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22252): Launched 12:44:52.734731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:44:53.009110 run patchelf(pid=22253): Launched 12:44:53.191362 run osmo-stp_10.42.42.5(pid=22250): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22250)] 12:44:53.328480 run osmo-stp_10.42.42.5(pid=22250): stdout: | (launched: 2022-12-13_12:44:51.865793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:53.467511 run osmo-stp_10.42.42.5(pid=22250): stderr: | 20221213124452058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124452058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124452058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124452059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124452059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124452059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124452059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:53.607184 run osmo-stp_10.42.42.5(pid=22250): stdout: | (launched: 2022-12-13_12:44:51.865793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:53.740255 run osmo-stp_10.42.42.5(pid=22250): stderr: | 20221213124452058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124452058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124452058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124452059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124452059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124452059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124452059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:53.897793 run patchelf(pid=22253): Terminating (SIGINT) 12:44:54.078519 run patchelf(pid=22253): Terminated: ok {rc=0} 12:44:54.208573 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22250): Process ended prematurely: osmo-stp_10.42.42.5(pid=22250) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22250)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 12:44:54.218396 tst ping.py:22: Test FAILED (6.6 sec) 12:44:54.246734 run osmo-hlr_10.42.42.2(pid=22247): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22247)] 12:44:54.297560 run osmo-hlr_10.42.42.2(pid=22247): stdout: | (launched: 2022-12-13_12:44:50.854306) 12:44:54.349700 run osmo-hlr_10.42.42.2(pid=22247): stderr: | 20221213124451052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124451052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124451052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124451052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124451052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124451052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124451065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124451073 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124451074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124451074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:54.402017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22246): Terminating (SIGTERM) 12:44:54.443674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22249): Terminating (SIGTERM) 12:44:54.486080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22252): Terminating (SIGTERM) 12:44:54.528799 --- ParallelTerminationStrategy: PID 22246 died... 12:44:54.549522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22246): Terminated: ok {rc=0} 12:44:54.596526 --- ParallelTerminationStrategy: PID 22249 died... 12:44:54.617053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22249): Terminated: ok {rc=0} 12:44:54.663849 --- ParallelTerminationStrategy: PID 22252 died... 12:44:54.684070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22252): Terminated: ok {rc=0} 12:44:54.773366 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:44:55.862451 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:55.874616 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:44:55.926453 tst ping_idle_ping.py: using LAC 34032 12:44:56.046218 tst ping_idle_ping.py: using RAC 117 12:44:56.164619 tst ping_idle_ping.py: using CellId 34032 12:44:56.289728 tst ping_idle_ping.py: using BVCI 34033 12:44:56.400447 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:56.411562 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:56.422456 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:56.433304 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:56.444241 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:56.455225 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:56.466435 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:44:56.477473 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:44:56.592599 tst ping_idle_ping.py:24: start network... 12:44:56.795135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:57.263792 run create_hlr_db(pid=22256): Launched 12:44:57.387396 bus /gobi_6: Setting Powered False 12:44:58.448379 run create_hlr_db(pid=22256): Terminated: ok {rc=0} 12:44:58.892587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22258): Launched 12:44:59.219124 run osmo-hlr_10.42.42.2(pid=22259): Launched 12:44:59.344300 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:59.904923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22261): Launched 12:45:00.230893 run osmo-stp_10.42.42.5(pid=22262): Launched 12:45:00.355955 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:45:00.937768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22264): Launched 12:45:01.085894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:45:01.364125 run patchelf(pid=22265): Launched 12:45:01.589402 run osmo-stp_10.42.42.5(pid=22262): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22262)] 12:45:01.734860 run osmo-stp_10.42.42.5(pid=22262): stdout: | (launched: 2022-12-13_12:45:00.170974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:01.876859 run osmo-stp_10.42.42.5(pid=22262): stderr: | 20221213124500363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124500363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124500363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124500364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124500364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124500364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124500365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:02.019413 run osmo-stp_10.42.42.5(pid=22262): stdout: | (launched: 2022-12-13_12:45:00.170974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:02.155031 run osmo-stp_10.42.42.5(pid=22262): stderr: | 20221213124500363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124500363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124500363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124500364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124500364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124500364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124500365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:02.314719 run patchelf(pid=22265): Terminating (SIGINT) 12:45:02.495827 run patchelf(pid=22265): Terminated: ok {rc=0} 12:45:02.627492 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22262): Process ended prematurely: osmo-stp_10.42.42.5(pid=22262) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22262)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 12:45:02.637508 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:45:02.666240 run osmo-hlr_10.42.42.2(pid=22259): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22259)] 12:45:02.716915 run osmo-hlr_10.42.42.2(pid=22259): stdout: | (launched: 2022-12-13_12:44:59.159660) 12:45:02.769231 run osmo-hlr_10.42.42.2(pid=22259): stderr: | 20221213124459357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124459357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124459357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124459357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124459357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124459357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124459370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124459381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124459381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124459381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:02.821480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22258): Terminating (SIGTERM) 12:45:02.863168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22261): Terminating (SIGTERM) 12:45:02.905590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22264): Terminating (SIGTERM) 12:45:02.948041 --- ParallelTerminationStrategy: PID 22258 died... 12:45:02.968691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22258): Terminated: ok {rc=0} 12:45:03.015507 --- ParallelTerminationStrategy: PID 22261 died... 12:45:03.035962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22261): Terminated: ok {rc=0} 12:45:03.082692 --- ParallelTerminationStrategy: PID 22264 died... 12:45:03.102967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22264): Terminated: ok {rc=0} 12:45:03.191690 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:45:04.504925 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:04.512420 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:45:04.546751 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:45:04.587143 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:45:04.678479 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:45:04.712033 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:45:04.752515 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:45:05.352007 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:45:05.402780 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:05.414033 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:45:05.481804 tst cs_paging_gprs_active.py: using LAC 34033 12:45:05.603829 tst cs_paging_gprs_active.py: using RAC 118 12:45:05.725430 tst cs_paging_gprs_active.py: using CellId 34033 12:45:05.845364 tst cs_paging_gprs_active.py: using BVCI 34034 12:45:05.957511 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:05.968477 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:05.979341 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:05.990186 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:06.001033 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:06.011831 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:06.022706 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:06.033417 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:06.044350 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:45:06.165415 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:45:06.283097 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:45:06.488110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:45:06.794307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22272): Launched 12:45:07.063297 run iperf3-srv_10.42.42.10(pid=22273): Launched 12:45:07.178060 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:45:07.382559 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:45:07.690382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22274): Launched 12:45:07.957699 run iperf3-srv_10.42.42.10(pid=22275): Launched 12:45:08.072937 tst cs_paging_gprs_active.py:38: start network... 12:45:08.278784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:08.754245 run create_hlr_db(pid=22276): Launched 12:45:08.881213 bus /gobi_6: Setting Powered False 12:45:09.942649 run create_hlr_db(pid=22276): Terminated: ok {rc=0} 12:45:10.391589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22278): Launched 12:45:10.723654 run osmo-hlr_10.42.42.2(pid=22279): Launched 12:45:10.851682 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:11.418041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22281): Launched 12:45:11.743521 run osmo-stp_10.42.42.5(pid=22282): Launched 12:45:11.861737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:45:12.393135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22284): Launched 12:45:12.511197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:45:12.771063 run patchelf(pid=22285): Launched 12:45:12.944021 run osmo-stp_10.42.42.5(pid=22282): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22282)] 12:45:13.074322 run osmo-stp_10.42.42.5(pid=22282): stdout: | (launched: 2022-12-13_12:45:11.686508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:13.206556 run osmo-stp_10.42.42.5(pid=22282): stderr: | 20221213124511854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124511855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124511855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124511855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124511856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124511856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124511856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:13.338802 run osmo-stp_10.42.42.5(pid=22282): stdout: | (launched: 2022-12-13_12:45:11.686508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:13.464201 run osmo-stp_10.42.42.5(pid=22282): stderr: | 20221213124511854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124511855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124511855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124511855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124511856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124511856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124511856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:13.613268 run patchelf(pid=22285): Terminating (SIGINT) 12:45:13.785455 run patchelf(pid=22285): Terminated: ok {rc=0} 12:45:13.909359 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22282): Process ended prematurely: osmo-stp_10.42.42.5(pid=22282) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22282)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:45:13.918917 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:45:13.946259 run osmo-hlr_10.42.42.2(pid=22279): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22279)] 12:45:13.993995 run osmo-hlr_10.42.42.2(pid=22279): stdout: | (launched: 2022-12-13_12:45:10.663370) 12:45:14.043562 run osmo-hlr_10.42.42.2(pid=22279): stderr: | 20221213124510862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124510862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124510862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124510862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124510862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124510862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124510874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124510883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124510884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124510884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:14.093463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22272): Terminating (SIGTERM) 12:45:14.133328 run iperf3-srv_10.42.42.10(pid=22273): Terminating (SIGTERM) 12:45:14.173238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22274): Terminating (SIGTERM) 12:45:14.213571 run iperf3-srv_10.42.42.10(pid=22275): Terminating (SIGTERM) 12:45:14.253207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22278): Terminating (SIGTERM) 12:45:14.292808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22281): Terminating (SIGTERM) 12:45:14.333050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22284): Terminating (SIGTERM) 12:45:14.373183 --- ParallelTerminationStrategy: PID 22272 died... 12:45:14.392598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22272): Terminated: ok {rc=0} 12:45:14.436788 --- ParallelTerminationStrategy: PID 22273 died... 12:45:14.455670 run iperf3-srv_10.42.42.10(pid=22273): Terminated {rc=256} 12:45:14.499530 --- ParallelTerminationStrategy: PID 22274 died... 12:45:14.518345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22274): Terminated: ok {rc=0} 12:45:14.562418 --- ParallelTerminationStrategy: PID 22275 died... 12:45:14.581239 run iperf3-srv_10.42.42.10(pid=22275): Terminated {rc=256} 12:45:14.625169 --- ParallelTerminationStrategy: PID 22278 died... 12:45:14.643986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22278): Terminated: ok {rc=0} 12:45:14.688171 --- ParallelTerminationStrategy: PID 22281 died... 12:45:14.707121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22281): Terminated: ok {rc=0} 12:45:14.751149 --- ParallelTerminationStrategy: PID 22284 died... 12:45:14.770043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22284): Terminated: ok {rc=0} 12:45:14.855078 bus /gobi_0: Setting Powered False 12:45:15.958838 bus /gobi_0: Setting Powered False 12:45:17.088611 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:45:18.237973 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:18.249754 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:45:18.320022 tst iperf3.py: using LAC 34034 12:45:18.442833 tst iperf3.py: using RAC 119 12:45:18.564236 tst iperf3.py: using CellId 34034 12:45:18.684033 tst iperf3.py: using BVCI 34035 12:45:18.795127 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:18.806320 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:18.817173 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:18.827993 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:18.838862 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:18.849730 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:18.860548 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:18.871305 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:18.882206 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:45:18.996717 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:45:19.203778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:45:19.513613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22286): Launched 12:45:19.787612 run iperf3-srv_10.42.42.10(pid=22287): Launched 12:45:19.904486 tst iperf3.py:8: start network... 12:45:20.111286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:20.593708 run create_hlr_db(pid=22288): Launched 12:45:20.719425 bus /gobi_6: Setting Powered False 12:45:21.779902 run create_hlr_db(pid=22288): Terminated: ok {rc=0} 12:45:22.230124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22290): Launched 12:45:22.562780 run osmo-hlr_10.42.42.2(pid=22291): Launched 12:45:22.689454 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:23.256731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22293): Launched 12:45:23.585037 run osmo-stp_10.42.42.5(pid=22294): Launched 12:45:23.710985 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:45:24.277302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22296): Launched 12:45:24.403748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:45:24.683078 run patchelf(pid=22297): Launched 12:45:24.866926 run osmo-stp_10.42.42.5(pid=22294): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22294)] 12:45:25.006089 run osmo-stp_10.42.42.5(pid=22294): stdout: | (launched: 2022-12-13_12:45:23.524179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:25.146236 run osmo-stp_10.42.42.5(pid=22294): stderr: | 20221213124523716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124523716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124523716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124523717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124523717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124523717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124523717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:25.286155 run osmo-stp_10.42.42.5(pid=22294): stdout: | (launched: 2022-12-13_12:45:23.524179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:25.420322 run osmo-stp_10.42.42.5(pid=22294): stderr: | 20221213124523716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124523716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124523716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124523717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124523717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124523717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124523717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:25.579214 run patchelf(pid=22297): Terminating (SIGINT) 12:45:25.763134 run patchelf(pid=22297): Terminated: ok {rc=0} 12:45:25.895694 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22294): Process ended prematurely: osmo-stp_10.42.42.5(pid=22294) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22294)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 12:45:25.906085 tst iperf3.py:8: Test FAILED (7.7 sec) 12:45:25.934761 run osmo-hlr_10.42.42.2(pid=22291): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22291)] 12:45:25.985383 run osmo-hlr_10.42.42.2(pid=22291): stdout: | (launched: 2022-12-13_12:45:22.501919) 12:45:26.037783 run osmo-hlr_10.42.42.2(pid=22291): stderr: | 20221213124522702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124522702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124522702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124522702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124522702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124522702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124522715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124522723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124522723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124522724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:26.090650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22286): Terminating (SIGTERM) 12:45:26.132401 run iperf3-srv_10.42.42.10(pid=22287): Terminating (SIGTERM) 12:45:26.174860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22290): Terminating (SIGTERM) 12:45:26.216916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22293): Terminating (SIGTERM) 12:45:26.258862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22296): Terminating (SIGTERM) 12:45:26.301140 --- ParallelTerminationStrategy: PID 22286 died... 12:45:26.321602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22286): Terminated: ok {rc=0} 12:45:26.368324 --- ParallelTerminationStrategy: PID 22287 died... 12:45:26.388222 run iperf3-srv_10.42.42.10(pid=22287): Terminated {rc=256} 12:45:26.434637 --- ParallelTerminationStrategy: PID 22290 died... 12:45:26.454758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22290): Terminated: ok {rc=0} 12:45:26.501293 --- ParallelTerminationStrategy: PID 22293 died... 12:45:26.521461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22293): Terminated: ok {rc=0} 12:45:26.567919 --- ParallelTerminationStrategy: PID 22296 died... 12:45:26.587815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22296): Terminated: ok {rc=0} 12:45:26.676761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:45:27.824131 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:27.836015 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:45:27.904724 tst iperf3m4.py: using LAC 34035 12:45:28.024628 tst iperf3m4.py: using RAC 120 12:45:28.144094 tst iperf3m4.py: using CellId 34035 12:45:28.265346 tst iperf3m4.py: using BVCI 34036 12:45:28.375771 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:28.386913 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:28.397987 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:28.408891 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:28.419857 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:28.431278 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:28.442716 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:28.454184 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:28.465618 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:45:28.587371 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:45:28.708105 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:45:28.826366 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:45:28.941619 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:45:29.147535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:45:29.455238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22298): Launched 12:45:29.723874 run iperf3-srv_10.42.42.10(pid=22299): Launched 12:45:29.839564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:45:30.045479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:45:30.354223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22300): Launched 12:45:30.625804 run iperf3-srv_10.42.42.10(pid=22301): Launched 12:45:30.743188 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:45:30.971255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:45:31.286670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22302): Launched 12:45:31.573741 run iperf3-srv_10.42.42.10(pid=22303): Launched 12:45:31.706954 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:45:31.939124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:45:32.278137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22304): Launched 12:45:32.565966 run iperf3-srv_10.42.42.10(pid=22305): Launched 12:45:32.692155 tst iperf3m4.py:8: start network... 12:45:32.915650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:33.426451 run create_hlr_db(pid=22306): Launched 12:45:33.553120 bus /gobi_6: Setting Powered False 12:45:34.617965 run create_hlr_db(pid=22306): Terminated: ok {rc=0} 12:45:35.075537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22308): Launched 12:45:35.406321 run osmo-hlr_10.42.42.2(pid=22309): Launched 12:45:35.533445 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:36.102947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22311): Launched 12:45:36.434773 run osmo-stp_10.42.42.5(pid=22312): Launched 12:45:36.561965 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:45:37.129579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22314): Launched 12:45:37.255695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:45:37.535164 run patchelf(pid=22315): Launched 12:45:37.719085 run osmo-stp_10.42.42.5(pid=22312): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22312)] 12:45:37.858686 run osmo-stp_10.42.42.5(pid=22312): stdout: | (launched: 2022-12-13_12:45:36.374146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:37.999535 run osmo-stp_10.42.42.5(pid=22312): stderr: | 20221213124536562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124536563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124536563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124536563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124536564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124536564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124536564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:38.140236 run osmo-stp_10.42.42.5(pid=22312): stdout: | (launched: 2022-12-13_12:45:36.374146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:38.274857 run osmo-stp_10.42.42.5(pid=22312): stderr: | 20221213124536562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124536563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124536563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124536563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124536564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124536564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124536564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:38.434115 run patchelf(pid=22315): Terminating (SIGINT) 12:45:38.618332 run patchelf(pid=22315): Terminated: ok {rc=0} 12:45:38.751717 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22312): Process ended prematurely: osmo-stp_10.42.42.5(pid=22312) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22312)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:45:38.762188 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:45:38.791012 run osmo-hlr_10.42.42.2(pid=22309): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22309)] 12:45:38.841582 run osmo-hlr_10.42.42.2(pid=22309): stdout: | (launched: 2022-12-13_12:45:35.345721) 12:45:38.893898 run osmo-hlr_10.42.42.2(pid=22309): stderr: | 20221213124535541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124535542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124535542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124535542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124535542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124535542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124535554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124535563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124535563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124535563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:38.946028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22298): Terminating (SIGTERM) 12:45:38.988263 run iperf3-srv_10.42.42.10(pid=22299): Terminating (SIGTERM) 12:45:39.030321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22300): Terminating (SIGTERM) 12:45:39.072240 run iperf3-srv_10.42.42.10(pid=22301): Terminating (SIGTERM) 12:45:39.114233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22302): Terminating (SIGTERM) 12:45:39.156096 run iperf3-srv_10.42.42.10(pid=22303): Terminating (SIGTERM) 12:45:39.198071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22304): Terminating (SIGTERM) 12:45:39.239962 run iperf3-srv_10.42.42.10(pid=22305): Terminating (SIGTERM) 12:45:39.281820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22308): Terminating (SIGTERM) 12:45:39.323748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22311): Terminating (SIGTERM) 12:45:39.366093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22314): Terminating (SIGTERM) 12:45:39.408767 --- ParallelTerminationStrategy: PID 22298 died... 12:45:39.429509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22298): Terminated: ok {rc=0} 12:45:39.476613 --- ParallelTerminationStrategy: PID 22299 died... 12:45:39.496597 run iperf3-srv_10.42.42.10(pid=22299): Terminated {rc=256} 12:45:39.542696 --- ParallelTerminationStrategy: PID 22300 died... 12:45:39.562684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22300): Terminated: ok {rc=0} 12:45:39.609547 --- ParallelTerminationStrategy: PID 22301 died... 12:45:39.629847 run iperf3-srv_10.42.42.10(pid=22301): Terminated {rc=256} 12:45:39.676078 --- ParallelTerminationStrategy: PID 22302 died... 12:45:39.696074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22302): Terminated: ok {rc=0} 12:45:39.742836 --- ParallelTerminationStrategy: PID 22303 died... 12:45:39.762885 run iperf3-srv_10.42.42.10(pid=22303): Terminated {rc=256} 12:45:39.809194 --- ParallelTerminationStrategy: PID 22304 died... 12:45:39.829318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22304): Terminated: ok {rc=0} 12:45:39.876304 --- ParallelTerminationStrategy: PID 22305 died... 12:45:39.896347 run iperf3-srv_10.42.42.10(pid=22305): Terminated {rc=256} 12:45:39.942564 --- ParallelTerminationStrategy: PID 22308 died... 12:45:39.962448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22308): Terminated: ok {rc=0} 12:45:40.008665 --- ParallelTerminationStrategy: PID 22311 died... 12:45:40.028664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22311): Terminated: ok {rc=0} 12:45:40.075180 --- ParallelTerminationStrategy: PID 22314 died... 12:45:40.095318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22314): Terminated: ok {rc=0} 12:45:40.184875 bus /gobi_4: Setting Powered False 12:45:41.284583 bus /gobi_4: Setting Powered False 12:45:42.401130 bus /gobi_1: Setting Powered False 12:45:43.500052 bus /gobi_1: Setting Powered False 12:45:44.616069 bus /gobi_0: Setting Powered False 12:45:45.715155 bus /gobi_0: Setting Powered False 12:45:46.831122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:45:47.934393 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:47.946832 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:45:48.018296 tst ping.py: using LAC 34036 12:45:48.136603 tst ping.py: using RAC 121 12:45:48.255333 tst ping.py: using CellId 34036 12:45:48.373998 tst ping.py: using BVCI 34037 12:45:48.482693 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:48.494164 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:48.505382 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:48.516455 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:48.527744 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:48.539102 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:48.550479 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:48.561646 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:45:48.680657 tst ping.py:19: start network... 12:45:48.899282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:49.399695 run create_hlr_db(pid=22316): Launched 12:45:49.525486 bus /gobi_6: Setting Powered False 12:45:50.589995 run create_hlr_db(pid=22316): Terminated: ok {rc=0} 12:45:51.022552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22318): Launched 12:45:51.326940 run osmo-hlr_10.42.42.2(pid=22319): Launched 12:45:51.444162 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:51.999162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22322): Launched 12:45:52.324651 run osmo-stp_10.42.42.5(pid=22323): Launched 12:45:52.449647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:45:53.008037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22325): Launched 12:45:53.133691 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:45:53.407634 run patchelf(pid=22326): Launched 12:45:53.589369 run osmo-stp_10.42.42.5(pid=22323): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22323)] 12:45:53.726426 run osmo-stp_10.42.42.5(pid=22323): stdout: | (launched: 2022-12-13_12:45:52.264828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:53.865189 run osmo-stp_10.42.42.5(pid=22323): stderr: | 20221213124552459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124552459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124552459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124552460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124552460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124552460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124552460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:54.003566 run osmo-stp_10.42.42.5(pid=22323): stdout: | (launched: 2022-12-13_12:45:52.264828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:54.135847 run osmo-stp_10.42.42.5(pid=22323): stderr: | 20221213124552459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124552459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124552459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124552460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124552460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124552460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124552460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:54.292273 run patchelf(pid=22326): Terminating (SIGINT) 12:45:54.472444 run patchelf(pid=22326): Terminated: ok {rc=0} 12:45:54.602684 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22323): Process ended prematurely: osmo-stp_10.42.42.5(pid=22323) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22323)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 12:45:54.612330 tst ping.py:22: Test FAILED (6.7 sec) 12:45:54.641648 run osmo-hlr_10.42.42.2(pid=22319): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22319)] 12:45:54.693253 run osmo-hlr_10.42.42.2(pid=22319): stdout: | (launched: 2022-12-13_12:45:51.270686) 12:45:54.745520 run osmo-hlr_10.42.42.2(pid=22319): stderr: | 20221213124551448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124551448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124551448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124551448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124551448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124551448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124551460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124551469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124551470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124551470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:54.797909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22318): Terminating (SIGTERM) 12:45:54.839810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22322): Terminating (SIGTERM) 12:45:54.882328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22325): Terminating (SIGTERM) 12:45:54.925118 --- ParallelTerminationStrategy: PID 22318 died... 12:45:54.945708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22318): Terminated: ok {rc=0} 12:45:54.992657 --- ParallelTerminationStrategy: PID 22322 died... 12:45:55.013092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22322): Terminated: ok {rc=0} 12:45:55.059969 --- ParallelTerminationStrategy: PID 22325 died... 12:45:55.080328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22325): Terminated: ok {rc=0} 12:45:55.169507 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:45:56.257469 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:56.269194 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:45:56.337408 tst ping_idle_ping.py: using LAC 34037 12:45:56.465768 tst ping_idle_ping.py: using RAC 122 12:45:56.592611 tst ping_idle_ping.py: using CellId 34037 12:45:56.713049 tst ping_idle_ping.py: using BVCI 34038 12:45:56.823978 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:56.835208 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:56.846482 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:56.857544 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:56.868501 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:56.879338 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:56.890268 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:45:56.901112 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:45:57.016706 tst ping_idle_ping.py:24: start network... 12:45:57.220630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:57.693163 run create_hlr_db(pid=22327): Launched 12:45:57.816651 bus /gobi_6: Setting Powered False 12:45:58.878160 run create_hlr_db(pid=22327): Terminated: ok {rc=0} 12:45:59.322839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22329): Launched 12:45:59.651091 run osmo-hlr_10.42.42.2(pid=22330): Launched 12:45:59.779104 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:00.339855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22332): Launched 12:46:00.667219 run osmo-stp_10.42.42.5(pid=22333): Launched 12:46:00.793113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:46:01.477920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22335): Launched 12:46:01.599775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:46:01.869795 run patchelf(pid=22336): Launched 12:46:02.062522 run osmo-stp_10.42.42.5(pid=22333): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22333)] 12:46:02.204394 run osmo-stp_10.42.42.5(pid=22333): stdout: | (launched: 2022-12-13_12:46:00.606529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:02.344136 run osmo-stp_10.42.42.5(pid=22333): stderr: | 20221213124600799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124600799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124600799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124600800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124600802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124600802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124600802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:02.483575 run osmo-stp_10.42.42.5(pid=22333): stdout: | (launched: 2022-12-13_12:46:00.606529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:02.616654 run osmo-stp_10.42.42.5(pid=22333): stderr: | 20221213124600799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124600799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124600799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124600800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124600802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124600802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124600802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:02.775321 run patchelf(pid=22336): Terminating (SIGINT) 12:46:02.956713 run patchelf(pid=22336): Terminated: ok {rc=0} 12:46:03.087744 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22333): Process ended prematurely: osmo-stp_10.42.42.5(pid=22333) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22333)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:46:03.097838 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:46:03.126305 run osmo-hlr_10.42.42.2(pid=22330): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22330)] 12:46:03.177267 run osmo-hlr_10.42.42.2(pid=22330): stdout: | (launched: 2022-12-13_12:45:59.590653) 12:46:03.230176 run osmo-hlr_10.42.42.2(pid=22330): stderr: | 20221213124559790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124559790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124559790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124559790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124559790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124559791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124559803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124559811 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124559811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124559811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:03.283169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22329): Terminating (SIGTERM) 12:46:03.325584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22332): Terminating (SIGTERM) 12:46:03.368430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22335): Terminating (SIGTERM) 12:46:03.411394 --- ParallelTerminationStrategy: PID 22329 died... 12:46:03.432187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22329): Terminated: ok {rc=0} 12:46:03.479258 --- ParallelTerminationStrategy: PID 22332 died... 12:46:03.499709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22332): Terminated: ok {rc=0} 12:46:03.546755 --- ParallelTerminationStrategy: PID 22335 died... 12:46:03.566886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22335): Terminated: ok {rc=0} 12:46:03.655764 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:46:04.975067 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:46:04.983013 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:46:05.016604 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 12:46:05.057752 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 12:46:05.148206 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:46:05.181246 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 12:46:05.220848 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 12:46:05.820519 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 12:46:05.869645 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:05.881320 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:46:05.933364 tst cs_paging_gprs_active.py: using LAC 34038 12:46:06.052118 tst cs_paging_gprs_active.py: using RAC 123 12:46:06.169617 tst cs_paging_gprs_active.py: using CellId 34038 12:46:06.288917 tst cs_paging_gprs_active.py: using BVCI 34039 12:46:06.398966 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:06.410549 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:06.421797 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:06.432931 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:06.444132 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:06.455251 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:06.466506 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:06.477540 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:06.488783 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:46:06.610647 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:46:06.730715 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:46:06.950513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:46:07.276776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22342): Launched 12:46:07.561503 run iperf3-srv_10.42.42.10(pid=22343): Launched 12:46:07.685684 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:46:07.904554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:46:08.231829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22344): Launched 12:46:08.516498 run iperf3-srv_10.42.42.10(pid=22345): Launched 12:46:08.639121 tst cs_paging_gprs_active.py:38: start network... 12:46:08.858786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:09.364014 run create_hlr_db(pid=22346): Launched 12:46:09.490357 bus /gobi_6: Setting Powered False 12:46:10.554322 run create_hlr_db(pid=22346): Terminated: ok {rc=0} 12:46:10.991470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22348): Launched 12:46:11.295682 run osmo-hlr_10.42.42.2(pid=22349): Launched 12:46:11.411589 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:11.938762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22351): Launched 12:46:12.243341 run osmo-stp_10.42.42.5(pid=22352): Launched 12:46:12.359975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:46:12.886634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22354): Launched 12:46:13.002854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:46:13.260204 run patchelf(pid=22355): Launched 12:46:13.429908 run osmo-stp_10.42.42.5(pid=22352): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22352)] 12:46:13.558182 run osmo-stp_10.42.42.5(pid=22352): stdout: | (launched: 2022-12-13_12:46:12.186340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:13.688673 run osmo-stp_10.42.42.5(pid=22352): stderr: | 20221213124612354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124612355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124612355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124612355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124612356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124612356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124612356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:13.819299 run osmo-stp_10.42.42.5(pid=22352): stdout: | (launched: 2022-12-13_12:46:12.186340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:13.943223 run osmo-stp_10.42.42.5(pid=22352): stderr: | 20221213124612354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124612355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124612355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124612355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124612356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124612356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124612356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:14.090208 run patchelf(pid=22355): Terminating (SIGINT) 12:46:14.260398 run patchelf(pid=22355): Terminated: ok {rc=0} 12:46:14.382950 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22352): Process ended prematurely: osmo-stp_10.42.42.5(pid=22352) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22352)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 12:46:14.392482 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:46:14.419570 run osmo-hlr_10.42.42.2(pid=22349): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22349)] 12:46:14.467746 run osmo-hlr_10.42.42.2(pid=22349): stdout: | (launched: 2022-12-13_12:46:11.239275) 12:46:14.517273 run osmo-hlr_10.42.42.2(pid=22349): stderr: | 20221213124611416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124611416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124611416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124611416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124611416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124611416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124611429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124611438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124611438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124611438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:14.566979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22342): Terminating (SIGTERM) 12:46:14.606864 run iperf3-srv_10.42.42.10(pid=22343): Terminating (SIGTERM) 12:46:14.646542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22344): Terminating (SIGTERM) 12:46:14.686418 run iperf3-srv_10.42.42.10(pid=22345): Terminating (SIGTERM) 12:46:14.726066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22348): Terminating (SIGTERM) 12:46:14.765961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22351): Terminating (SIGTERM) 12:46:14.806048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22354): Terminating (SIGTERM) 12:46:14.846244 --- ParallelTerminationStrategy: PID 22342 died... 12:46:14.865467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22342): Terminated: ok {rc=0} 12:46:14.909421 --- ParallelTerminationStrategy: PID 22343 died... 12:46:14.927877 run iperf3-srv_10.42.42.10(pid=22343): Terminated {rc=256} 12:46:14.971734 --- ParallelTerminationStrategy: PID 22344 died... 12:46:14.990488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22344): Terminated: ok {rc=0} 12:46:15.034159 --- ParallelTerminationStrategy: PID 22345 died... 12:46:15.052766 run iperf3-srv_10.42.42.10(pid=22345): Terminated {rc=256} 12:46:15.096587 --- ParallelTerminationStrategy: PID 22348 died... 12:46:15.115303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22348): Terminated: ok {rc=0} 12:46:15.159017 --- ParallelTerminationStrategy: PID 22351 died... 12:46:15.177522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22351): Terminated: ok {rc=0} 12:46:15.221284 --- ParallelTerminationStrategy: PID 22354 died... 12:46:15.240047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22354): Terminated: ok {rc=0} 12:46:15.323804 bus /gobi_0: Setting Powered False 12:46:16.420345 bus /gobi_0: Setting Powered False 12:46:17.537562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 12:46:18.684195 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:18.696307 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:46:18.746928 tst iperf3.py: using LAC 34039 12:46:18.877125 tst iperf3.py: using RAC 124 12:46:18.998328 tst iperf3.py: using CellId 34039 12:46:19.119428 tst iperf3.py: using BVCI 34040 12:46:19.231647 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:19.243294 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:19.254662 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:19.266020 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:19.277259 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:19.288518 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:19.299802 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:19.310896 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:19.322301 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:46:19.444399 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:46:19.664100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:46:19.990278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22356): Launched 12:46:20.272480 run iperf3-srv_10.42.42.10(pid=22357): Launched 12:46:20.396337 tst iperf3.py:8: start network... 12:46:20.614956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:21.117545 run create_hlr_db(pid=22358): Launched 12:46:21.243776 bus /gobi_6: Setting Powered False 12:46:22.307096 run create_hlr_db(pid=22358): Terminated: ok {rc=0} 12:46:22.757689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22360): Launched 12:46:23.085398 run osmo-hlr_10.42.42.2(pid=22361): Launched 12:46:23.210525 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:23.774885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22363): Launched 12:46:24.099360 run osmo-stp_10.42.42.5(pid=22364): Launched 12:46:24.223407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:46:24.782965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22366): Launched 12:46:24.907460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:46:25.182179 run patchelf(pid=22367): Launched 12:46:25.362881 run osmo-stp_10.42.42.5(pid=22364): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22364)] 12:46:25.500626 run osmo-stp_10.42.42.5(pid=22364): stdout: | (launched: 2022-12-13_12:46:24.039677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:25.639615 run osmo-stp_10.42.42.5(pid=22364): stderr: | 20221213124624232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124624232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124624233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124624233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124624234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124624234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124624234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:25.779289 run osmo-stp_10.42.42.5(pid=22364): stdout: | (launched: 2022-12-13_12:46:24.039677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:25.912134 run osmo-stp_10.42.42.5(pid=22364): stderr: | 20221213124624232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124624232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124624233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124624233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124624234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124624234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124624234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:26.069770 run patchelf(pid=22367): Terminating (SIGINT) 12:46:26.250861 run patchelf(pid=22367): Terminated: ok {rc=0} 12:46:26.382157 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22364): Process ended prematurely: osmo-stp_10.42.42.5(pid=22364) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22364)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 12:46:26.392570 tst iperf3.py:8: Test FAILED (7.7 sec) 12:46:26.421210 run osmo-hlr_10.42.42.2(pid=22361): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22361)] 12:46:26.472352 run osmo-hlr_10.42.42.2(pid=22361): stdout: | (launched: 2022-12-13_12:46:23.024934) 12:46:26.524904 run osmo-hlr_10.42.42.2(pid=22361): stderr: | 20221213124623225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124623225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124623225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124623225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124623225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124623225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124623237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124623246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124623246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124623246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:26.578043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22356): Terminating (SIGTERM) 12:46:26.619567 run iperf3-srv_10.42.42.10(pid=22357): Terminating (SIGTERM) 12:46:26.662213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22360): Terminating (SIGTERM) 12:46:26.704209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22363): Terminating (SIGTERM) 12:46:26.746192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22366): Terminating (SIGTERM) 12:46:26.788064 --- ParallelTerminationStrategy: PID 22356 died... 12:46:26.808243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22356): Terminated: ok {rc=0} 12:46:26.854469 --- ParallelTerminationStrategy: PID 22357 died... 12:46:26.874261 run iperf3-srv_10.42.42.10(pid=22357): Terminated {rc=256} 12:46:26.920296 --- ParallelTerminationStrategy: PID 22360 died... 12:46:26.940276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22360): Terminated: ok {rc=0} 12:46:26.986393 --- ParallelTerminationStrategy: PID 22363 died... 12:46:27.006140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22363): Terminated: ok {rc=0} 12:46:27.052313 --- ParallelTerminationStrategy: PID 22366 died... 12:46:27.072104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22366): Terminated: ok {rc=0} 12:46:27.159722 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 12:46:28.310204 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:28.323044 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:46:28.378606 tst iperf3m4.py: using LAC 34040 12:46:28.506621 tst iperf3m4.py: using RAC 125 12:46:28.633730 tst iperf3m4.py: using CellId 34040 12:46:28.761447 tst iperf3m4.py: using BVCI 34041 12:46:28.880895 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:28.892939 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:28.904872 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:28.916712 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:28.929060 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:28.941332 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:28.953904 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:28.965980 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:28.978569 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:46:29.096512 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:46:29.219269 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:46:29.338698 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:46:29.457995 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:46:29.665337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:46:29.972430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22368): Launched 12:46:30.239667 run iperf3-srv_10.42.42.10(pid=22369): Launched 12:46:30.354442 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:46:30.558491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:46:30.881316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22370): Launched 12:46:31.202397 run iperf3-srv_10.42.42.10(pid=22371): Launched 12:46:31.341138 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:46:31.567321 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:46:31.907792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22372): Launched 12:46:32.207267 run iperf3-srv_10.42.42.10(pid=22373): Launched 12:46:32.331182 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:46:32.552000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:46:32.881715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22374): Launched 12:46:33.166229 run iperf3-srv_10.42.42.10(pid=22375): Launched 12:46:33.289944 tst iperf3m4.py:8: start network... 12:46:33.509829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:34.013969 run create_hlr_db(pid=22376): Launched 12:46:34.140808 bus /gobi_6: Setting Powered False 12:46:35.205191 run create_hlr_db(pid=22376): Terminated: ok {rc=0} 12:46:35.658634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22378): Launched 12:46:35.983301 run osmo-hlr_10.42.42.2(pid=22379): Launched 12:46:36.109190 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:36.672370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22381): Launched 12:46:37.000779 run osmo-stp_10.42.42.5(pid=22382): Launched 12:46:37.125928 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:46:37.693184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22384): Launched 12:46:37.819386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:46:38.094532 run patchelf(pid=22385): Launched 12:46:38.276179 run osmo-stp_10.42.42.5(pid=22382): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22382)] 12:46:38.413921 run osmo-stp_10.42.42.5(pid=22382): stdout: | (launched: 2022-12-13_12:46:36.940623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:38.552572 run osmo-stp_10.42.42.5(pid=22382): stderr: | 20221213124637130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124637131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124637131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124637131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124637132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124637132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124637132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:38.691995 run osmo-stp_10.42.42.5(pid=22382): stdout: | (launched: 2022-12-13_12:46:36.940623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:38.825197 run osmo-stp_10.42.42.5(pid=22382): stderr: | 20221213124637130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124637131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124637131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124637131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124637132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124637132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124637132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:38.982325 run patchelf(pid=22385): Terminating (SIGINT) 12:46:39.164257 run patchelf(pid=22385): Terminated: ok {rc=0} 12:46:39.296099 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22382): Process ended prematurely: osmo-stp_10.42.42.5(pid=22382) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22382)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 12:46:39.306726 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:46:39.335861 run osmo-hlr_10.42.42.2(pid=22379): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22379)] 12:46:39.386817 run osmo-hlr_10.42.42.2(pid=22379): stdout: | (launched: 2022-12-13_12:46:35.923663) 12:46:39.439258 run osmo-hlr_10.42.42.2(pid=22379): stderr: | 20221213124636119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124636119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124636119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124636119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124636119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124636119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124636131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124636139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124636139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124636140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:39.491991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22368): Terminating (SIGTERM) 12:46:39.533980 run iperf3-srv_10.42.42.10(pid=22369): Terminating (SIGTERM) 12:46:39.576033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22370): Terminating (SIGTERM) 12:46:39.618244 run iperf3-srv_10.42.42.10(pid=22371): Terminating (SIGTERM) 12:46:39.660453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22372): Terminating (SIGTERM) 12:46:39.703331 run iperf3-srv_10.42.42.10(pid=22373): Terminating (SIGTERM) 12:46:39.745884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22374): Terminating (SIGTERM) 12:46:39.787848 run iperf3-srv_10.42.42.10(pid=22375): Terminating (SIGTERM) 12:46:39.829778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22378): Terminating (SIGTERM) 12:46:39.871732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22381): Terminating (SIGTERM) 12:46:39.914083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22384): Terminating (SIGTERM) 12:46:39.956364 --- ParallelTerminationStrategy: PID 22368 died... 12:46:39.976587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22368): Terminated: ok {rc=0} 12:46:40.022889 --- ParallelTerminationStrategy: PID 22369 died... 12:46:40.042527 run iperf3-srv_10.42.42.10(pid=22369): Terminated {rc=256} 12:46:40.088763 --- ParallelTerminationStrategy: PID 22370 died... 12:46:40.108604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22370): Terminated: ok {rc=0} 12:46:40.154814 --- ParallelTerminationStrategy: PID 22371 died... 12:46:40.174697 run iperf3-srv_10.42.42.10(pid=22371): Terminated {rc=256} 12:46:40.220641 --- ParallelTerminationStrategy: PID 22372 died... 12:46:40.240381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22372): Terminated: ok {rc=0} 12:46:40.286406 --- ParallelTerminationStrategy: PID 22373 died... 12:46:40.306142 run iperf3-srv_10.42.42.10(pid=22373): Terminated {rc=256} 12:46:40.352237 --- ParallelTerminationStrategy: PID 22374 died... 12:46:40.371971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22374): Terminated: ok {rc=0} 12:46:40.417928 --- ParallelTerminationStrategy: PID 22375 died... 12:46:40.437700 run iperf3-srv_10.42.42.10(pid=22375): Terminated {rc=256} 12:46:40.483828 --- ParallelTerminationStrategy: PID 22378 died... 12:46:40.503703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22378): Terminated: ok {rc=0} 12:46:40.549833 --- ParallelTerminationStrategy: PID 22381 died... 12:46:40.569722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22381): Terminated: ok {rc=0} 12:46:40.615745 --- ParallelTerminationStrategy: PID 22384 died... 12:46:40.635591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22384): Terminated: ok {rc=0} 12:46:40.724306 bus /gobi_4: Setting Powered False 12:46:41.823517 bus /gobi_4: Setting Powered False 12:46:42.939064 bus /gobi_1: Setting Powered False 12:46:44.037865 bus /gobi_1: Setting Powered False 12:46:45.152847 bus /gobi_0: Setting Powered False 12:46:46.256077 bus /gobi_0: Setting Powered False 12:46:47.384460 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 12:46:48.488141 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:48.500307 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:46:48.557349 tst ping.py: using LAC 34041 12:46:48.679264 tst ping.py: using RAC 126 12:46:48.795837 tst ping.py: using CellId 34041 12:46:48.922315 tst ping.py: using BVCI 34042 12:46:49.039816 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:49.052156 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:49.064208 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:49.076389 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:49.089110 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:49.101789 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:49.114476 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:49.127076 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:46:49.245831 tst ping.py:19: start network... 12:46:49.447047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:49.910504 run create_hlr_db(pid=22386): Launched 12:46:50.034690 bus /gobi_6: Setting Powered False 12:46:51.095273 run create_hlr_db(pid=22386): Terminated: ok {rc=0} 12:46:51.535015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22388): Launched 12:46:51.857694 run osmo-hlr_10.42.42.2(pid=22389): Launched 12:46:51.982260 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:52.537684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22391): Launched 12:46:52.860460 run osmo-stp_10.42.42.5(pid=22392): Launched 12:46:52.982622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:46:53.533183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22394): Launched 12:46:53.657152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:46:53.927581 run patchelf(pid=22395): Launched 12:46:54.106773 run osmo-stp_10.42.42.5(pid=22392): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22392)] 12:46:54.242107 run osmo-stp_10.42.42.5(pid=22392): stdout: | (launched: 2022-12-13_12:46:52.801147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:54.379146 run osmo-stp_10.42.42.5(pid=22392): stderr: | 20221213124652992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124652992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124652992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124652993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124652993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124652993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124652993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:54.516758 run osmo-stp_10.42.42.5(pid=22392): stdout: | (launched: 2022-12-13_12:46:52.801147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:54.647314 run osmo-stp_10.42.42.5(pid=22392): stderr: | 20221213124652992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124652992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124652992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124652993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124652993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124652993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124652993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:54.803200 run patchelf(pid=22395): Terminating (SIGINT) 12:46:54.981664 run patchelf(pid=22395): Terminated: ok {rc=0} 12:46:55.110306 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22392): Process ended prematurely: osmo-stp_10.42.42.5(pid=22392) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22392)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 12:46:55.119950 tst ping.py:22: Test FAILED (6.6 sec) 12:46:55.148276 run osmo-hlr_10.42.42.2(pid=22389): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22389)] 12:46:55.199113 run osmo-hlr_10.42.42.2(pid=22389): stdout: | (launched: 2022-12-13_12:46:51.798816) 12:46:55.251878 run osmo-hlr_10.42.42.2(pid=22389): stderr: | 20221213124651997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124651997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124651997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124651997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124651997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124651997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124652010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124652021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124652022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124652022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:55.305214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22388): Terminating (SIGTERM) 12:46:55.347212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22391): Terminating (SIGTERM) 12:46:55.389564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22394): Terminating (SIGTERM) 12:46:55.432137 --- ParallelTerminationStrategy: PID 22388 died... 12:46:55.452937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22388): Terminated: ok {rc=0} 12:46:55.500316 --- ParallelTerminationStrategy: PID 22391 died... 12:46:55.520764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22391): Terminated: ok {rc=0} 12:46:55.567771 --- ParallelTerminationStrategy: PID 22394 died... 12:46:55.588283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22394): Terminated: ok {rc=0} 12:46:55.677501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 12:46:56.765590 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:56.778011 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:46:56.828640 tst ping_idle_ping.py: using LAC 34042 12:46:56.946809 tst ping_idle_ping.py: using RAC 127 12:46:57.066692 tst ping_idle_ping.py: using CellId 34042 12:46:57.187843 tst ping_idle_ping.py: using BVCI 34043 12:46:57.296654 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:57.308295 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:57.319695 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:57.331100 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:57.342897 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:57.354912 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:57.366882 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:46:57.378904 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:46:57.499288 tst ping_idle_ping.py:24: start network... 12:46:57.701564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:58.168665 run create_hlr_db(pid=22396): Launched 12:46:58.291465 bus /gobi_6: Setting Powered False 12:46:59.351286 run create_hlr_db(pid=22396): Terminated: ok {rc=0} 12:46:59.771431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22398): Launched 12:47:00.072557 run osmo-hlr_10.42.42.2(pid=22399): Launched 12:47:00.188005 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:00.721021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22401): Launched 12:47:01.064744 run osmo-stp_10.42.42.5(pid=22402): Launched 12:47:01.304009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:47:01.960315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22404): Launched 12:47:02.097619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:47:02.371991 run patchelf(pid=22405): Launched 12:47:02.550738 run osmo-stp_10.42.42.5(pid=22402): ERR: Terminated: ERROR {rc=1} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22402)] 12:47:02.686633 run osmo-stp_10.42.42.5(pid=22402): stdout: | (launched: 2022-12-13_12:47:01.000213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:02.825229 run osmo-stp_10.42.42.5(pid=22402): stderr: | 20221213124701307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124701307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124701307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124701307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124701308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124701308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124701308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:02.963154 run osmo-stp_10.42.42.5(pid=22402): stdout: | (launched: 2022-12-13_12:47:01.000213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:03.094993 run osmo-stp_10.42.42.5(pid=22402): stderr: | 20221213124701307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124701307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124701307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124701307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124701308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124701308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124701308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:03.251184 run patchelf(pid=22405): Terminating (SIGINT) 12:47:03.430651 run patchelf(pid=22405): Terminated: ok {rc=0} 12:47:03.559912 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22402): Process ended prematurely: osmo-stp_10.42.42.5(pid=22402) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22402)] [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 12:47:03.569892 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:47:03.598147 run osmo-hlr_10.42.42.2(pid=22399): ERR: Terminated: ERROR {rc=237} [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22399)] 12:47:03.649161 run osmo-hlr_10.42.42.2(pid=22399): stdout: | (launched: 2022-12-13_12:47:00.016610) 12:47:03.702337 run osmo-hlr_10.42.42.2(pid=22399): stderr: | 20221213124700193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124700194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124700194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124700194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124700194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124700194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124700206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124700217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124700218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124700218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:03.755371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22398): Terminating (SIGTERM) 12:47:03.797439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22401): Terminating (SIGTERM) 12:47:03.839798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22404): Terminating (SIGTERM) 12:47:03.882371 --- ParallelTerminationStrategy: PID 22398 died... 12:47:03.903027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22398): Terminated: ok {rc=0} 12:47:03.949941 --- ParallelTerminationStrategy: PID 22401 died... 12:47:03.970102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22401): Terminated: ok {rc=0} 12:47:04.016849 --- ParallelTerminationStrategy: PID 22404 died... 12:47:04.037566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22404): Terminated: ok {rc=0} 12:47:04.126908 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 12:47:05.445564 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:05.452721 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:47:05.484771 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:47:05.519283 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:47:05.573837 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:47:05.606409 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:47:05.640626 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:47:06.205723 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2389 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:47:06.211491 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:47:06.223667 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:47:06.294197 tst switch_tch_pdch.py: using LAC 34043 12:47:06.411199 tst switch_tch_pdch.py: using RAC 128 12:47:06.529040 tst switch_tch_pdch.py: using CellId 34043 12:47:06.646873 tst switch_tch_pdch.py: using BVCI 34044 12:47:06.754356 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:47:06.765991 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:47:06.777454 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:47:06.788942 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:47:06.800450 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:47:06.811884 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:47:06.823428 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:47:06.835395 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:47:06.955022 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:47:07.073134 tst switch_tch_pdch.py:51: start network... 12:47:07.274061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:07.736537 run create_hlr_db(pid=22411): Launched 12:47:07.858102 bus /gobi_6: Setting Powered False 12:47:08.917286 run create_hlr_db(pid=22411): Terminated: ok {rc=0} 12:47:09.354688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22413): Launched 12:47:09.676295 run osmo-hlr_10.42.42.2(pid=22414): Launched 12:47:09.798889 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:10.351875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22416): Launched 12:47:10.674127 run osmo-stp_10.42.42.5(pid=22417): Launched 12:47:10.797756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:47:11.349989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22419): Launched 12:47:11.473972 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:47:11.745772 run patchelf(pid=22420): Launched 12:47:11.923624 run osmo-stp_10.42.42.5(pid=22417): ERR: Terminated: ERROR {rc=1} [trial-2389↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22417)] 12:47:12.059261 run osmo-stp_10.42.42.5(pid=22417): stdout: | (launched: 2022-12-13_12:47:10.615168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:12.196336 run osmo-stp_10.42.42.5(pid=22417): stderr: | 20221213124710806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124710806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124710806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124710807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124710807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124710807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124710807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:12.333760 run osmo-stp_10.42.42.5(pid=22417): stdout: | (launched: 2022-12-13_12:47:10.615168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:12.465018 run osmo-stp_10.42.42.5(pid=22417): stderr: | 20221213124710806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124710806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124710806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124710807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124710807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124710807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124710807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:12.620289 run patchelf(pid=22420): Terminating (SIGINT) 12:47:12.798818 run patchelf(pid=22420): Terminated: ok {rc=0} 12:47:12.927410 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22417): Process ended prematurely: osmo-stp_10.42.42.5(pid=22417) [trial-2389↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22417)] [trial-2389↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:47:12.937297 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:47:12.965351 run osmo-hlr_10.42.42.2(pid=22414): ERR: Terminated: ERROR {rc=237} [trial-2389↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22414)] 12:47:13.015794 run osmo-hlr_10.42.42.2(pid=22414): stdout: | (launched: 2022-12-13_12:47:09.617200) 12:47:13.067785 run osmo-hlr_10.42.42.2(pid=22414): stderr: | 20221213124709817 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124709817 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124709817 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124709817 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124709817 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124709817 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124709830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124709839 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124709839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124709839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:13.120173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22413): Terminating (SIGTERM) 12:47:13.162438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22416): Terminating (SIGTERM) 12:47:13.205038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22419): Terminating (SIGTERM) 12:47:13.247762 --- ParallelTerminationStrategy: PID 22413 died... 12:47:13.268206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22413): Terminated: ok {rc=0} 12:47:13.314755 --- ParallelTerminationStrategy: PID 22416 died... 12:47:13.334721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22416): Terminated: ok {rc=0} 12:47:13.381079 --- ParallelTerminationStrategy: PID 22419 died... 12:47:13.400729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22419): Terminated: ok {rc=0} 12:47:13.490204 bus /gobi_0: Setting Powered False 12:47:14.587532 bus /gobi_0: Setting Powered False 12:47:15.702214 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2389 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 nitb_smpp --------------------------------------------------------------------- 12:47:16.964932 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:16.967807 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 12:47:16.994316 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 12:47:17.006698 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 12:47:17.059822 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 12:47:17.096435 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 12:47:17.107291 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 12:47:17.598935 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2389 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 12:47:17.605025 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:47:17.624656 tst esme_connect_policy_acceptall.py: using MSISDN 8158 12:47:17.759334 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:47:18.331375 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22424): Launched 12:47:18.637177 run osmo-nitb_10.42.42.2(pid=22425): Launched 12:47:18.805833 run osmo-nitb_10.42.42.2(pid=22425): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22425)] 12:47:18.941854 run osmo-nitb_10.42.42.2(pid=22425): stdout: | (launched: 2022-12-13_12:47:18.580792) 12:47:19.079605 run osmo-nitb_10.42.42.2(pid=22425): stderr: | (launched: 2022-12-13_12:47:18.626017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:47:19.217402 run osmo-nitb_10.42.42.2(pid=22425): stdout: | (launched: 2022-12-13_12:47:18.580792) 12:47:19.350251 run osmo-nitb_10.42.42.2(pid=22425): stderr: | (launched: 2022-12-13_12:47:18.626017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22425): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22425) [trial-2389↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22425)] 12:47:19.752323 tst osmo-nitb_10.42.42.2(pid=22425): stdout: | (launched: 2022-12-13_12:47:18.580792) 12:47:19.875433 tst osmo-nitb_10.42.42.2(pid=22425): stderr: | (launched: 2022-12-13_12:47:18.626017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:47:20.020116 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=22425): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22425) [trial-2389↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22425)] [trial-2389↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 12:47:20.028515 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 12:47:20.034985 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22424): Terminating (SIGTERM) 12:47:20.243258 --- ParallelTerminationStrategy: PID 22424 died... 12:47:20.263758 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22424): Terminated: ok {rc=0} ---------------------------------------------- trial-2389 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 12:47:20.311859 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:47:20.333673 tst esme_connect_policy_closed.py: using MSISDN 8159 12:47:20.456708 tst esme_connect_policy_closed.py: using MSISDN 8160 12:47:20.567913 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:47:21.135473 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22426): Launched 12:47:21.443110 run osmo-nitb_10.42.42.2(pid=22427): Launched 12:47:21.607552 run osmo-nitb_10.42.42.2(pid=22427): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22427)] 12:47:21.733215 run osmo-nitb_10.42.42.2(pid=22427): stdout: | (launched: 2022-12-13_12:47:21.386414) 12:47:21.859986 run osmo-nitb_10.42.42.2(pid=22427): stderr: | (launched: 2022-12-13_12:47:21.431933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:47:21.986971 run osmo-nitb_10.42.42.2(pid=22427): stdout: | (launched: 2022-12-13_12:47:21.386414) 12:47:22.108429 run osmo-nitb_10.42.42.2(pid=22427): stderr: | (launched: 2022-12-13_12:47:21.431933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:47:22.253864 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=22427): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22427) [trial-2389↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22427)] [trial-2389↪nitb_smpp↪esme_connect_policy_closed.py:24] 12:47:22.262400 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 12:47:22.269166 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22426): Terminating (SIGTERM) 12:47:22.477452 --- ParallelTerminationStrategy: PID 22426 died... 12:47:22.498326 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22426): Terminated: ok {rc=0} ---------------------------------------------- trial-2389 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 12:47:22.546567 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:47:22.557958 tst nitb_smpp: Using 1 x bts (candidates: 1) 12:47:22.596101 tst esme_ms_sms_storeforward.py: using LAC 34044 12:47:22.720653 tst esme_ms_sms_storeforward.py: using RAC 129 12:47:22.840348 tst esme_ms_sms_storeforward.py: using CellId 34044 12:47:22.959231 tst esme_ms_sms_storeforward.py: using BVCI 34045 12:47:23.071339 tst nitb_smpp: Using 1 x modem (candidates: 1) 12:47:23.198912 tst esme_ms_sms_storeforward.py: using MSISDN 8161 12:47:23.317936 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 12:47:23.542004 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:47:24.211666 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22428): Launched 12:47:24.542422 run osmo-nitb_10.42.42.2(pid=22429): Launched 12:47:24.721550 run osmo-nitb_10.42.42.2(pid=22429): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22429)] 12:47:24.856737 run osmo-nitb_10.42.42.2(pid=22429): stdout: | (launched: 2022-12-13_12:47:24.482154) 12:47:24.993406 run osmo-nitb_10.42.42.2(pid=22429): stderr: | (launched: 2022-12-13_12:47:24.530948) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:47:25.130377 run osmo-nitb_10.42.42.2(pid=22429): stdout: | (launched: 2022-12-13_12:47:24.482154) 12:47:25.261160 run osmo-nitb_10.42.42.2(pid=22429): stderr: | (launched: 2022-12-13_12:47:24.530948) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:47:25.417876 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=22429): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22429) [trial-2389↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22429)] [trial-2389↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 12:47:25.426758 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 12:47:25.433808 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22428): Terminating (SIGTERM) 12:47:25.644294 --- ParallelTerminationStrategy: PID 22428 died... 12:47:25.665441 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22428): Terminated: ok {rc=0} 12:47:25.755096 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 12:47:26.840878 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:47:26.852785 tst nitb_smpp: Using 1 x bts (candidates: 1) 12:47:26.889265 tst esme_ms_sms_transaction.py: using LAC 34045 12:47:27.011036 tst esme_ms_sms_transaction.py: using RAC 130 12:47:27.132235 tst esme_ms_sms_transaction.py: using CellId 34045 12:47:27.253463 tst esme_ms_sms_transaction.py: using BVCI 34046 12:47:27.363563 tst nitb_smpp: Using 1 x modem (candidates: 1) 12:47:27.494763 tst esme_ms_sms_transaction.py: using MSISDN 8162 12:47:27.615324 tst esme_ms_sms_transaction.py:18: start nitb and bts... 12:47:27.838899 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:47:28.502982 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22430): Launched 12:47:28.832440 run osmo-nitb_10.42.42.2(pid=22431): Launched 12:47:29.015009 run osmo-nitb_10.42.42.2(pid=22431): ERR: Terminated: ERROR {rc=2} [trial-2389↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22431)] 12:47:29.161334 run osmo-nitb_10.42.42.2(pid=22431): stdout: | (launched: 2022-12-13_12:47:28.772437) 12:47:29.309210 run osmo-nitb_10.42.42.2(pid=22431): stderr: | (launched: 2022-12-13_12:47:28.820885) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:47:29.457574 run osmo-nitb_10.42.42.2(pid=22431): stdout: | (launched: 2022-12-13_12:47:28.772437) 12:47:29.599431 run osmo-nitb_10.42.42.2(pid=22431): stderr: | (launched: 2022-12-13_12:47:28.820885) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8b485c268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22431): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22431) [trial-2389↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22431)] 12:47:29.957504 tst osmo-nitb_10.42.42.2(pid=22431): stdout: | (launched: 2022-12-13_12:47:28.772437) 12:47:30.090052 tst osmo-nitb_10.42.42.2(pid=22431): stderr: | (launched: 2022-12-13_12:47:28.820885) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:47:30.246696 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=22431): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22431) [trial-2389↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22431)] [trial-2389↪nitb_smpp↪esme_ms_sms_transaction.py:21] 12:47:30.255918 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 12:47:30.262983 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22430): Terminating (SIGTERM) 12:47:30.474279 --- ParallelTerminationStrategy: PID 22430 died... 12:47:30.495955 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22430): Terminated: ok {rc=0} 12:47:30.584444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 smpp --------------------------------------------------------------------- 12:47:31.750682 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:31.754403 tst smpp: Verifying 1 x bts (candidates: 11) 12:47:31.777431 tst smpp: Verifying 6 x ip_address (candidates: 9) 12:47:31.809096 tst smpp: Verifying 1 x modem (candidates: 12) 12:47:31.847573 tst smpp: Reserving 1 x bts (candidates: 11) 12:47:31.870450 tst smpp: Reserving 6 x ip_address (candidates: 9) 12:47:31.917546 tst smpp: Reserving 1 x modem (candidates: 12) 12:47:32.424663 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 12:47:32.431804 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:32.443780 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:32.454879 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:32.465902 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:32.488471 tst esme_connect_policy_acceptall.py: using MSISDN 8163 12:47:32.608778 run osmo-stp_10.42.42.4: Starting osmo-stp 12:47:33.169181 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22435): Launched 12:47:33.498868 run osmo-stp_10.42.42.4(pid=22436): Launched 12:47:33.625798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:34.134455 run create_hlr_db(pid=22437): Launched 12:47:34.258777 bus /sierra_2: Setting Powered False 12:47:35.324277 run create_hlr_db(pid=22437): Terminated: ok {rc=0} 12:47:35.761882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22439): Launched 12:47:36.068065 run osmo-hlr_10.42.42.2(pid=22440): Launched 12:47:36.184605 run osmo-msc_10.42.42.5: Starting osmo-msc 12:47:36.739870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22442): Launched 12:47:37.048126 run osmo-msc_10.42.42.5(pid=22443): Launched 12:47:37.259190 run osmo-hlr_10.42.42.2(pid=22440): ERR: Terminated: ERROR {rc=237} [trial-2389↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22440)] 12:47:37.393379 run osmo-hlr_10.42.42.2(pid=22440): stdout: | (launched: 2022-12-13_12:47:36.011201) 12:47:37.524699 run osmo-hlr_10.42.42.2(pid=22440): stderr: | 20221213124736186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124736186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124736186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124736186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124736186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124736186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124736198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124736206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124736206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124736206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:37.653398 run osmo-hlr_10.42.42.2(pid=22440): stdout: | (launched: 2022-12-13_12:47:36.011201) 12:47:37.778016 run osmo-hlr_10.42.42.2(pid=22440): stderr: | 20221213124736186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124736186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124736186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124736186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124736186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124736186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124736198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124736206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124736206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124736206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:37.925621 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=22440): Process ended prematurely: osmo-hlr_10.42.42.2(pid=22440) [trial-2389↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22440)] [trial-2389↪smpp↪esme_connect_policy_acceptall.py:23] 12:47:37.933915 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.5 sec) 12:47:37.960056 run osmo-msc_10.42.42.5(pid=22443): ERR: Terminated: ERROR {rc=9} [trial-2389↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=22443)] 12:47:38.008452 run osmo-msc_10.42.42.5(pid=22443): stdout: | (launched: 2022-12-13_12:47:36.990336) 12:47:38.058133 run osmo-msc_10.42.42.5(pid=22443): stderr: | 20221213124737306 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213124737306 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213124737306 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124737306 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213124737306 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213124737306 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213124737307 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213124737307 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213124737307 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 12:47:38.108087 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22435): Terminating (SIGTERM) 12:47:38.147802 run osmo-stp_10.42.42.4(pid=22436): Terminating (SIGTERM) 12:47:38.187390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22439): Terminating (SIGTERM) 12:47:38.228462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22442): Terminating (SIGTERM) 12:47:38.269231 --- ParallelTerminationStrategy: PID 22435 died... 12:47:38.288550 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22435): Terminated: ok {rc=0} 12:47:38.332821 --- ParallelTerminationStrategy: PID 22436 died... 12:47:38.351497 run osmo-stp_10.42.42.4(pid=22436): Terminated: ok {rc=0} 12:47:38.395355 --- ParallelTerminationStrategy: PID 22439 died... 12:47:38.413922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22439): Terminated: ok {rc=0} 12:47:38.457868 --- ParallelTerminationStrategy: PID 22442 died... 12:47:38.476462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22442): Terminated: ok {rc=0} ---------------------------------------------- trial-2389 smpp esme_connect_policy_closed.py ---------------------------------------------- 12:47:38.525126 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:38.536159 tst smpp: Using 1 x bts (candidates: 1) 12:47:38.570121 tst esme_connect_policy_closed.py: using LAC 34046 12:47:38.690482 tst esme_connect_policy_closed.py: using RAC 131 12:47:38.811005 tst esme_connect_policy_closed.py: using CellId 34046 12:47:38.931345 tst esme_connect_policy_closed.py: using BVCI 34047 12:47:39.044420 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:39.054972 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:39.065513 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:39.084166 tst esme_connect_policy_closed.py: using MSISDN 8164 12:47:39.203533 tst esme_connect_policy_closed.py: using MSISDN 8165 12:47:39.326743 run osmo-stp_10.42.42.4: Starting osmo-stp 12:47:39.894891 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22446): Launched 12:47:40.229037 run osmo-stp_10.42.42.4(pid=22447): Launched 12:47:40.357888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:40.875053 run create_hlr_db(pid=22448): Launched 12:47:42.061260 run create_hlr_db(pid=22448): Terminated: ok {rc=0} 12:47:42.413120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22450): Launched 12:47:42.748094 run osmo-hlr_10.42.42.2(pid=22451): Launched 12:47:42.875350 run osmo-msc_10.42.42.5: Starting osmo-msc 12:47:43.484294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22453): Launched 12:47:43.820910 run osmo-msc_10.42.42.5(pid=22454): Launched 12:47:44.006167 run osmo-hlr_10.42.42.2(pid=22451): ERR: Terminated: ERROR {rc=237} [trial-2389↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22451)] 12:47:44.147508 run osmo-hlr_10.42.42.2(pid=22451): stdout: | (launched: 2022-12-13_12:47:42.686655) 12:47:44.293642 run osmo-hlr_10.42.42.2(pid=22451): stderr: | 20221213124742884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124742884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124742884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124742884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124742884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124742884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124742896 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124742905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124742905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124742905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:44.433979 run osmo-hlr_10.42.42.2(pid=22451): stdout: | (launched: 2022-12-13_12:47:42.686655) 12:47:44.566439 run osmo-hlr_10.42.42.2(pid=22451): stderr: | 20221213124742884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124742884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124742884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124742884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124742884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124742884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124742896 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124742905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124742905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124742905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:44.725691 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=22451): Process ended prematurely: osmo-hlr_10.42.42.2(pid=22451) [trial-2389↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22451)] [trial-2389↪smpp↪esme_connect_policy_closed.py:31] 12:47:44.735089 tst esme_connect_policy_closed.py:31: Test FAILED (6.2 sec) 12:47:44.762822 run osmo-msc_10.42.42.5(pid=22454): ERR: Terminated: ERROR {rc=9} [trial-2389↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=22454)] 12:47:44.814499 run osmo-msc_10.42.42.5(pid=22454): stdout: | (launched: 2022-12-13_12:47:43.759313) 12:47:44.868030 run osmo-msc_10.42.42.5(pid=22454): stderr: | 20221213124744128 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213124744128 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213124744128 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124744129 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213124744129 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213124744129 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213124744129 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213124744129 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213124744129 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 12:47:44.920683 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22446): Terminating (SIGTERM) 12:47:44.963185 run osmo-stp_10.42.42.4(pid=22447): Terminating (SIGTERM) 12:47:45.005839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22450): Terminating (SIGTERM) 12:47:45.049656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22453): Terminating (SIGTERM) 12:47:45.095040 --- ParallelTerminationStrategy: PID 22446 died... 12:47:45.116504 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22446): Terminated: ok {rc=0} 12:47:45.165869 --- ParallelTerminationStrategy: PID 22447 died... 12:47:45.186197 run osmo-stp_10.42.42.4(pid=22447): Terminated: ok {rc=0} 12:47:45.233472 --- ParallelTerminationStrategy: PID 22450 died... 12:47:45.253949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22450): Terminated: ok {rc=0} 12:47:45.301222 --- ParallelTerminationStrategy: PID 22453 died... 12:47:45.321767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22453): Terminated: ok {rc=0} ---------------------------------------------- trial-2389 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 12:47:45.374644 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:45.386344 tst smpp: Using 1 x bts (candidates: 1) 12:47:45.422358 tst esme_ms_sms_storeforward.py: using LAC 34047 12:47:45.548293 tst esme_ms_sms_storeforward.py: using RAC 132 12:47:45.673147 tst esme_ms_sms_storeforward.py: using CellId 34047 12:47:45.796317 tst esme_ms_sms_storeforward.py: using BVCI 34048 12:47:45.942306 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:45.953104 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:45.964093 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:45.975120 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:45.986630 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:45.998183 tst smpp: Using 1 x modem (candidates: 1) 12:47:46.155940 tst esme_ms_sms_storeforward.py: using MSISDN 8166 12:47:46.281571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:46.816555 run create_hlr_db(pid=22457): Launched 12:47:48.038907 run create_hlr_db(pid=22457): Terminated: ok {rc=0} 12:47:48.391776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22459): Launched 12:47:48.728870 run osmo-hlr_10.42.42.2(pid=22460): Launched 12:47:48.858153 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:49.438070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22462): Launched 12:47:49.775075 run osmo-stp_10.42.42.5(pid=22463): Launched 12:47:49.904098 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:50.506102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22465): Launched 12:47:50.841918 run osmo-msc_10.42.42.6(pid=22466): Launched 12:47:51.028383 run osmo-stp_10.42.42.5(pid=22463): ERR: Terminated: ERROR {rc=1} [trial-2389↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22463)] 12:47:51.169331 run osmo-stp_10.42.42.5(pid=22463): stdout: | (launched: 2022-12-13_12:47:49.713193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:51.311187 run osmo-stp_10.42.42.5(pid=22463): stderr: | 20221213124749911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124749911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124749912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124749912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124749912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124749912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124749913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:51.450951 run osmo-stp_10.42.42.5(pid=22463): stdout: | (launched: 2022-12-13_12:47:49.713193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:51.584596 run osmo-stp_10.42.42.5(pid=22463): stderr: | 20221213124749911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124749911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124749912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124749912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124749912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124749912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124749913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:51.744462 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=22463): Process ended prematurely: osmo-stp_10.42.42.5(pid=22463) [trial-2389↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22463)] [trial-2389↪smpp↪esme_ms_sms_storeforward.py:30] 12:47:51.753886 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.4 sec) 12:47:51.781382 run osmo-hlr_10.42.42.2(pid=22460): ERR: Terminated: ERROR {rc=237} [trial-2389↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22460)] 12:47:51.832631 run osmo-hlr_10.42.42.2(pid=22460): stdout: | (launched: 2022-12-13_12:47:48.666773) 12:47:51.885471 run osmo-hlr_10.42.42.2(pid=22460): stderr: | 20221213124748870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124748870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124748870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124748870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124748870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124748870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124748883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124748895 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124748895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124748895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:51.958431 run osmo-msc_10.42.42.6(pid=22466): ERR: Terminated: ERROR {rc=2} [trial-2389↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22466)] 12:47:52.008506 run osmo-msc_10.42.42.6(pid=22466): stdout: | (launched: 2022-12-13_12:47:50.780344) 12:47:52.061165 run osmo-msc_10.42.42.6(pid=22466): stderr: | 20221213124751105 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124751105 DLGLOBAL DEBUG validating counter group 0x7fbab31b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124751105 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124751105 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124751106 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124751106 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124751108 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124751108 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124751108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124751108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:52.113794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22459): Terminating (SIGTERM) 12:47:52.156171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22462): Terminating (SIGTERM) 12:47:52.199200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22465): Terminating (SIGTERM) 12:47:52.242554 --- ParallelTerminationStrategy: PID 22459 died... 12:47:52.263448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22459): Terminated: ok {rc=0} 12:47:52.310670 --- ParallelTerminationStrategy: PID 22462 died... 12:47:52.331004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22462): Terminated: ok {rc=0} 12:47:52.377845 --- ParallelTerminationStrategy: PID 22465 died... 12:47:52.398213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22465): Terminated: ok {rc=0} 12:47:52.487947 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 smpp esme_ms_sms_transaction.py ---------------------------------------------- 12:47:53.576209 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:53.588192 tst smpp: Using 1 x bts (candidates: 1) 12:47:53.625950 tst esme_ms_sms_transaction.py: using LAC 34048 12:47:53.748848 tst esme_ms_sms_transaction.py: using RAC 133 12:47:53.883060 tst esme_ms_sms_transaction.py: using CellId 34048 12:47:54.012883 tst esme_ms_sms_transaction.py: using BVCI 34049 12:47:54.134626 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:54.145803 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:54.156715 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:54.167855 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:54.179717 tst smpp: Using 1 x ip_address (candidates: 6) 12:47:54.191499 tst smpp: Using 1 x modem (candidates: 1) 12:47:54.322978 tst esme_ms_sms_transaction.py: using MSISDN 8167 12:47:54.436936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:54.919858 run create_hlr_db(pid=22468): Launched 12:47:55.047080 bus /sierra_2: Setting Powered False 12:47:56.108817 run create_hlr_db(pid=22468): Terminated: ok {rc=0} 12:47:56.565624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22470): Launched 12:47:56.905583 run osmo-hlr_10.42.42.2(pid=22471): Launched 12:47:57.034346 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:57.610411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22473): Launched 12:47:57.944146 run osmo-stp_10.42.42.5(pid=22474): Launched 12:47:58.074744 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:58.677985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22476): Launched 12:47:59.012775 run osmo-msc_10.42.42.6(pid=22477): Launched 12:47:59.201203 run osmo-stp_10.42.42.5(pid=22474): ERR: Terminated: ERROR {rc=1} [trial-2389↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22474)] 12:47:59.345791 run osmo-stp_10.42.42.5(pid=22474): stdout: | (launched: 2022-12-13_12:47:57.882613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:59.485571 run osmo-stp_10.42.42.5(pid=22474): stderr: | 20221213124758076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124758076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124758076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124758077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124758077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124758077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124758077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:59.624659 run osmo-stp_10.42.42.5(pid=22474): stdout: | (launched: 2022-12-13_12:47:57.882613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:59.758859 run osmo-stp_10.42.42.5(pid=22474): stderr: | 20221213124758076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124758076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124758076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124758077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124758077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124758077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124758077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:59.918488 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=22474): Process ended prematurely: osmo-stp_10.42.42.5(pid=22474) [trial-2389↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22474)] [trial-2389↪smpp↪esme_ms_sms_transaction.py:28] 12:47:59.927747 tst esme_ms_sms_transaction.py:28: Test FAILED (6.3 sec) 12:47:59.955396 run osmo-hlr_10.42.42.2(pid=22471): ERR: Terminated: ERROR {rc=237} [trial-2389↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22471)] 12:48:00.006998 run osmo-hlr_10.42.42.2(pid=22471): stdout: | (launched: 2022-12-13_12:47:56.843180) 12:48:00.060198 run osmo-hlr_10.42.42.2(pid=22471): stderr: | 20221213124757047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124757047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124757047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124757047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124757047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124757047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124757098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124757108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124757108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124757108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:00.134088 run osmo-msc_10.42.42.6(pid=22477): ERR: Terminated: ERROR {rc=2} [trial-2389↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22477)] 12:48:00.184709 run osmo-msc_10.42.42.6(pid=22477): stdout: | (launched: 2022-12-13_12:47:58.950956) 12:48:00.237768 run osmo-msc_10.42.42.6(pid=22477): stderr: | 20221213124759276 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124759276 DLGLOBAL DEBUG validating counter group 0x7fc45ebd1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124759276 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124759276 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124759276 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124759276 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124759278 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124759279 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124759279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124759279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:00.290717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22470): Terminating (SIGTERM) 12:48:00.332915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22473): Terminating (SIGTERM) 12:48:00.375769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22476): Terminating (SIGTERM) 12:48:00.418650 --- ParallelTerminationStrategy: PID 22470 died... 12:48:00.439499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22470): Terminated: ok {rc=0} 12:48:00.486639 --- ParallelTerminationStrategy: PID 22473 died... 12:48:00.506731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22473): Terminated: ok {rc=0} 12:48:00.553429 --- ParallelTerminationStrategy: PID 22476 died... 12:48:00.573607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22476): Terminated: ok {rc=0} 12:48:00.662106 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 encryption --------------------------------------------------------------------- 12:48:01.871931 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:01.876181 tst encryption: Verifying 1 x bts (candidates: 11) 12:48:01.916643 tst encryption: Verifying 6 x ip_address (candidates: 9) 12:48:01.947311 tst encryption: Verifying 1 x modem (candidates: 12) 12:48:01.986135 tst encryption: Reserving 1 x bts (candidates: 11) 12:48:02.013710 tst encryption: Reserving 6 x ip_address (candidates: 9) 12:48:02.049532 tst encryption: Reserving 1 x modem (candidates: 12) 12:48:02.564107 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2389 encryption register_a5_0_authopt.py ---------------------------------------------- 12:48:02.619022 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:02.629852 tst encryption: Using 1 x bts (candidates: 1) 12:48:02.663997 tst register_a5_0_authopt.py: using LAC 34049 12:48:02.791625 tst register_a5_0_authopt.py: using RAC 134 12:48:02.914697 tst register_a5_0_authopt.py: using CellId 34049 12:48:03.043602 tst register_a5_0_authopt.py: using BVCI 34050 12:48:03.157431 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:03.167880 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:03.178412 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:03.188747 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:03.199133 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:03.209514 tst encryption: Using 1 x modem (candidates: 1) 12:48:03.330152 tst register_a5_0_authopt.py:8: start network... 12:48:03.560261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:04.082598 run create_hlr_db(pid=22482): Launched 12:48:04.213415 bus /sierra_2: Setting Powered False 12:48:05.279382 run create_hlr_db(pid=22482): Terminated: ok {rc=0} 12:48:05.729585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22484): Launched 12:48:06.047286 run osmo-hlr_10.42.42.2(pid=22485): Launched 12:48:06.167087 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:06.708282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22487): Launched 12:48:07.024546 run osmo-stp_10.42.42.5(pid=22488): Launched 12:48:07.144461 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:07.710142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22490): Launched 12:48:08.025255 run osmo-msc_10.42.42.6(pid=22491): Launched 12:48:08.200568 run osmo-stp_10.42.42.5(pid=22488): ERR: Terminated: ERROR {rc=1} [trial-2389↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22488)] 12:48:08.332707 run osmo-stp_10.42.42.5(pid=22488): stdout: | (launched: 2022-12-13_12:48:06.965541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:08.464882 run osmo-stp_10.42.42.5(pid=22488): stderr: | 20221213124807138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124807138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124807139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124807139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124807140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124807140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124807140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:08.595398 run osmo-stp_10.42.42.5(pid=22488): stdout: | (launched: 2022-12-13_12:48:06.965541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:08.720065 run osmo-stp_10.42.42.5(pid=22488): stderr: | 20221213124807138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124807138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124807139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124807139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124807140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124807140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124807140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:08.869578 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22488): Process ended prematurely: osmo-stp_10.42.42.5(pid=22488) [trial-2389↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22488)] [trial-2389↪encryption↪register_a5_0_authopt.py:8] 12:48:08.878822 tst register_a5_0_authopt.py:8: Test FAILED (6.3 sec) 12:48:08.905283 run osmo-hlr_10.42.42.2(pid=22485): ERR: Terminated: ERROR {rc=237} [trial-2389↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22485)] 12:48:08.953082 run osmo-hlr_10.42.42.2(pid=22485): stdout: | (launched: 2022-12-13_12:48:05.988621) 12:48:09.002579 run osmo-hlr_10.42.42.2(pid=22485): stderr: | 20221213124806166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124806166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124806166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124806166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124806166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124806166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124806221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124806230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124806230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124806231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:09.071711 run osmo-msc_10.42.42.6(pid=22491): ERR: Terminated: ERROR {rc=2} [trial-2389↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22491)] 12:48:09.119560 run osmo-msc_10.42.42.6(pid=22491): stdout: | (launched: 2022-12-13_12:48:07.966636) 12:48:09.169098 run osmo-msc_10.42.42.6(pid=22491): stderr: | 20221213124808241 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124808241 DLGLOBAL DEBUG validating counter group 0x7f4b35877c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124808241 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124808241 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124808241 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124808242 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124808245 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124808245 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124808246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124808246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:09.219140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22484): Terminating (SIGTERM) 12:48:09.259291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22487): Terminating (SIGTERM) 12:48:09.299386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22490): Terminating (SIGTERM) 12:48:09.339777 --- ParallelTerminationStrategy: PID 22484 died... 12:48:09.358701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22484): Terminated: ok {rc=0} 12:48:09.402892 --- ParallelTerminationStrategy: PID 22487 died... 12:48:09.421710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22487): Terminated: ok {rc=0} 12:48:09.465508 --- ParallelTerminationStrategy: PID 22490 died... 12:48:09.483949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22490): Terminated: ok {rc=0} 12:48:09.567987 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 encryption register_a5_0_authreq.py ---------------------------------------------- 12:48:10.713991 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:10.725371 tst encryption: Using 1 x bts (candidates: 1) 12:48:10.761358 tst register_a5_0_authreq.py: using LAC 34050 12:48:10.884627 tst register_a5_0_authreq.py: using RAC 135 12:48:11.009433 tst register_a5_0_authreq.py: using CellId 34050 12:48:11.132203 tst register_a5_0_authreq.py: using BVCI 34051 12:48:11.245875 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:11.256562 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:11.267292 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:11.277875 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:11.288597 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:11.299249 tst encryption: Using 1 x modem (candidates: 1) 12:48:11.418745 tst register_a5_0_authreq.py:8: start network... 12:48:11.631384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:12.118689 run create_hlr_db(pid=22493): Launched 12:48:12.249407 bus /sierra_2: Setting Powered False 12:48:13.312058 run create_hlr_db(pid=22493): Terminated: ok {rc=0} 12:48:13.765552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22495): Launched 12:48:14.084208 run osmo-hlr_10.42.42.2(pid=22496): Launched 12:48:14.205882 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:14.766706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22498): Launched 12:48:15.084393 run osmo-stp_10.42.42.5(pid=22499): Launched 12:48:15.206252 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:15.772924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22501): Launched 12:48:16.104339 run osmo-msc_10.42.42.6(pid=22502): Launched 12:48:16.437821 run osmo-stp_10.42.42.5(pid=22499): ERR: Terminated: ERROR {rc=1} [trial-2389↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22499)] 12:48:16.717137 run osmo-stp_10.42.42.5(pid=22499): stdout: | (launched: 2022-12-13_12:48:15.025855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:16.863768 run osmo-stp_10.42.42.5(pid=22499): stderr: | 20221213124815198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124815198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124815199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124815199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124815199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124815200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124815200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:17.009388 run osmo-stp_10.42.42.5(pid=22499): stdout: | (launched: 2022-12-13_12:48:15.025855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:17.148866 run osmo-stp_10.42.42.5(pid=22499): stderr: | 20221213124815198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124815198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124815199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124815199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124815199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124815200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124815200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:17.313792 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22499): Process ended prematurely: osmo-stp_10.42.42.5(pid=22499) [trial-2389↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22499)] [trial-2389↪encryption↪register_a5_0_authreq.py:8] 12:48:17.323976 tst register_a5_0_authreq.py:8: Test FAILED (6.6 sec) 12:48:17.352688 run osmo-hlr_10.42.42.2(pid=22496): ERR: Terminated: ERROR {rc=237} [trial-2389↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22496)] 12:48:17.403377 run osmo-hlr_10.42.42.2(pid=22496): stdout: | (launched: 2022-12-13_12:48:14.024775) 12:48:17.457079 run osmo-hlr_10.42.42.2(pid=22496): stderr: | 20221213124814207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124814207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124814207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124814207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124814207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124814207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124814219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124814227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124814227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124814227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:17.526677 run osmo-msc_10.42.42.6(pid=22502): ERR: Terminated: ERROR {rc=2} [trial-2389↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22502)] 12:48:17.574875 run osmo-msc_10.42.42.6(pid=22502): stdout: | (launched: 2022-12-13_12:48:16.044656) 12:48:17.625361 run osmo-msc_10.42.42.6(pid=22502): stderr: | 20221213124816481 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124816482 DLGLOBAL DEBUG validating counter group 0x7f10c2a01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124816482 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124816482 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124816482 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124816482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124816484 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124816484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124816484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124816493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:17.675432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22495): Terminating (SIGTERM) 12:48:17.715943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22498): Terminating (SIGTERM) 12:48:17.756386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22501): Terminating (SIGTERM) 12:48:17.797740 --- ParallelTerminationStrategy: PID 22495 died... 12:48:17.817388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22495): Terminated: ok {rc=0} 12:48:17.862345 --- ParallelTerminationStrategy: PID 22498 died... 12:48:17.881358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22498): Terminated: ok {rc=0} 12:48:17.925880 --- ParallelTerminationStrategy: PID 22501 died... 12:48:17.944936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22501): Terminated: ok {rc=0} 12:48:18.032202 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 encryption register_a5_1_authreq.py ---------------------------------------------- 12:48:19.181602 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:19.193049 tst encryption: Using 1 x bts (candidates: 1) 12:48:19.231614 tst register_a5_1_authreq.py: using LAC 34051 12:48:19.353029 tst register_a5_1_authreq.py: using RAC 136 12:48:19.475166 tst register_a5_1_authreq.py: using CellId 34051 12:48:19.597631 tst register_a5_1_authreq.py: using BVCI 34052 12:48:19.713095 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:19.723668 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:19.734276 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:19.744616 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:19.755055 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:19.765455 tst encryption: Using 1 x modem (candidates: 1) 12:48:19.888341 tst register_a5_1_authreq.py:8: start network... 12:48:20.100290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:20.587920 run create_hlr_db(pid=22504): Launched 12:48:20.717719 bus /sierra_2: Setting Powered False 12:48:21.780400 run create_hlr_db(pid=22504): Terminated: ok {rc=0} 12:48:22.241562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22506): Launched 12:48:22.583361 run osmo-hlr_10.42.42.2(pid=22507): Launched 12:48:22.715369 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:23.297583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22509): Launched 12:48:23.637491 run osmo-stp_10.42.42.5(pid=22510): Launched 12:48:23.767026 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:24.377151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22512): Launched 12:48:24.717340 run osmo-msc_10.42.42.6(pid=22513): Launched 12:48:24.907204 run osmo-stp_10.42.42.5(pid=22510): ERR: Terminated: ERROR {rc=1} [trial-2389↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22510)] 12:48:25.049558 run osmo-stp_10.42.42.5(pid=22510): stdout: | (launched: 2022-12-13_12:48:23.575088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:25.192614 run osmo-stp_10.42.42.5(pid=22510): stderr: | 20221213124823771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124823771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124823772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124823772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124823773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124823773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124823773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:25.333945 run osmo-stp_10.42.42.5(pid=22510): stdout: | (launched: 2022-12-13_12:48:23.575088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:25.468776 run osmo-stp_10.42.42.5(pid=22510): stderr: | 20221213124823771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124823771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124823772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124823772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124823773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124823773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124823773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:25.630526 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22510): Process ended prematurely: osmo-stp_10.42.42.5(pid=22510) [trial-2389↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22510)] [trial-2389↪encryption↪register_a5_1_authreq.py:8] 12:48:25.640506 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 12:48:25.668937 run osmo-hlr_10.42.42.2(pid=22507): ERR: Terminated: ERROR {rc=237} [trial-2389↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22507)] 12:48:25.721123 run osmo-hlr_10.42.42.2(pid=22507): stdout: | (launched: 2022-12-13_12:48:22.520698) 12:48:25.774652 run osmo-hlr_10.42.42.2(pid=22507): stderr: | 20221213124822722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124822722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124822722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124822722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124822722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124822722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124822735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124822746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124822746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124822746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:25.848595 run osmo-msc_10.42.42.6(pid=22513): ERR: Terminated: ERROR {rc=2} [trial-2389↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22513)] 12:48:25.899108 run osmo-msc_10.42.42.6(pid=22513): stdout: | (launched: 2022-12-13_12:48:24.654683) 12:48:25.951917 run osmo-msc_10.42.42.6(pid=22513): stderr: | 20221213124824981 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124824982 DLGLOBAL DEBUG validating counter group 0x7fa7dcc50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124824982 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124824982 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124824982 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124824982 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124824984 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124824984 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124824984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124824984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:26.004822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22506): Terminating (SIGTERM) 12:48:26.046952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22509): Terminating (SIGTERM) 12:48:26.090235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22512): Terminating (SIGTERM) 12:48:26.133159 --- ParallelTerminationStrategy: PID 22506 died... 12:48:26.153847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22506): Terminated: ok {rc=0} 12:48:26.200834 --- ParallelTerminationStrategy: PID 22509 died... 12:48:26.221548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22509): Terminated: ok {rc=0} 12:48:26.268667 --- ParallelTerminationStrategy: PID 22512 died... 12:48:26.289161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22512): Terminated: ok {rc=0} 12:48:26.380042 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2389 encryption register_a5_3_authreq.py ---------------------------------------------- 12:48:27.534766 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:27.546533 tst encryption: Using 1 x bts (candidates: 1) 12:48:27.585581 tst register_a5_3_authreq.py: using LAC 34052 12:48:27.719132 tst register_a5_3_authreq.py: using RAC 137 12:48:27.853953 tst register_a5_3_authreq.py: using CellId 34052 12:48:27.988907 tst register_a5_3_authreq.py: using BVCI 34053 12:48:28.105274 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:28.115820 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:28.126452 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:28.136924 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:28.147443 tst encryption: Using 1 x ip_address (candidates: 6) 12:48:28.158468 tst encryption: Using 1 x modem (candidates: 1) 12:48:28.289583 tst register_a5_3_authreq.py:8: start network... 12:48:28.518435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:29.038738 run create_hlr_db(pid=22515): Launched 12:48:29.168000 bus /sierra_2: Setting Powered False 12:48:30.233219 run create_hlr_db(pid=22515): Terminated: ok {rc=0} 12:48:30.681692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22517): Launched 12:48:31.043686 run osmo-hlr_10.42.42.2(pid=22518): Launched 12:48:31.368280 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:32.162261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22520): Launched 12:48:32.494493 run osmo-stp_10.42.42.5(pid=22521): Launched 12:48:32.617652 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:33.199799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22523): Launched 12:48:33.516689 run osmo-msc_10.42.42.6(pid=22524): Launched 12:48:33.692710 run osmo-stp_10.42.42.5(pid=22521): ERR: Terminated: ERROR {rc=1} [trial-2389↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22521)] 12:48:33.826069 run osmo-stp_10.42.42.5(pid=22521): stdout: | (launched: 2022-12-13_12:48:32.435709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:33.959682 run osmo-stp_10.42.42.5(pid=22521): stderr: | 20221213124832609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124832609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124832609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124832610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124832610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124832610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124832610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:34.090226 run osmo-stp_10.42.42.5(pid=22521): stdout: | (launched: 2022-12-13_12:48:32.435709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:34.215523 run osmo-stp_10.42.42.5(pid=22521): stderr: | 20221213124832609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213124832609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213124832609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213124832610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213124832610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213124832610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213124832610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:34.365089 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22521): Process ended prematurely: osmo-stp_10.42.42.5(pid=22521) [trial-2389↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22521)] [trial-2389↪encryption↪register_a5_3_authreq.py:8] 12:48:34.374330 tst register_a5_3_authreq.py:8: Test FAILED (6.9 sec) 12:48:34.400536 run osmo-hlr_10.42.42.2(pid=22518): ERR: Terminated: ERROR {rc=237} [trial-2389↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22518)] 12:48:34.448343 run osmo-hlr_10.42.42.2(pid=22518): stdout: | (launched: 2022-12-13_12:48:30.977947) 12:48:34.497867 run osmo-hlr_10.42.42.2(pid=22518): stderr: | 20221213124831377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213124831377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213124831378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213124831378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213124831378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213124831378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213124831392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213124831414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213124831416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213124831417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:34.566778 run osmo-msc_10.42.42.6(pid=22524): ERR: Terminated: ERROR {rc=2} [trial-2389↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22524)] 12:48:34.614136 run osmo-msc_10.42.42.6(pid=22524): stdout: | (launched: 2022-12-13_12:48:33.458409) 12:48:34.663341 run osmo-msc_10.42.42.6(pid=22524): stderr: | 20221213124833735 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213124833735 DLGLOBAL DEBUG validating counter group 0x7f176edc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213124833735 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213124833735 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213124833735 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213124833735 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213124833737 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213124833738 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213124833738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213124833738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:34.712784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22517): Terminating (SIGTERM) 12:48:34.752482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22520): Terminating (SIGTERM) 12:48:34.792232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22523): Terminating (SIGTERM) 12:48:34.832038 --- ParallelTerminationStrategy: PID 22517 died... 12:48:34.851188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22517): Terminated: ok {rc=0} 12:48:34.895063 --- ParallelTerminationStrategy: PID 22520 died... 12:48:34.913656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22520): Terminated: ok {rc=0} 12:48:34.957530 --- ParallelTerminationStrategy: PID 22523 died... 12:48:34.976144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22523): Terminated: ok {rc=0} 12:48:35.061503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 12:48:36.271606 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:36.276802 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 12:48:36.295454 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 12:48:36.323789 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 12:48:36.352390 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 12:48:36.372309 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 12:48:36.400472 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 12:48:36.910851 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2389 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 12:48:36.915674 tst handover.py:11: TEST_CONFIG: {} 12:48:37.142997 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:48:37.159464 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:48:37.183263 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:48:37.235481 tst handover.py: using MSISDN 8168 12:48:37.359203 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8168', subscriber_id=0} 12:48:37.477125 run srsepc_10.42.42.118: Starting srsepc 12:48:39.421342 run rm-remote-dir(pid=22530): Launched 12:48:39.556478 bus /sierra_2: Setting Powered False 12:48:40.626920 run rm-remote-dir(pid=22530): Terminated: ok {rc=0} 12:48:41.111236 run mk-remote-dir(pid=22531): Launched 12:48:42.308359 run mk-remote-dir(pid=22531): Terminated: ok {rc=0} 12:48:42.625516 run scp-inst-to-remote(pid=22532): Launched 12:48:44.822248 run scp-inst-to-remote(pid=22532): Terminated: ok {rc=0} 12:48:45.189946 run rm-remote-dir(pid=22534): Launched 12:48:46.384595 run rm-remote-dir(pid=22534): Terminated: ok {rc=0} 12:48:46.773495 run mk-remote-dir(pid=22535): Launched 12:48:48.013841 run mk-remote-dir(pid=22535): Terminated: ok {rc=0} 12:48:48.309192 run scp-cfg-to-remote(pid=22536): Launched 12:48:49.491894 run scp-cfg-to-remote(pid=22536): Terminated: ok {rc=0} 12:48:49.785381 run scp-db-to-remote(pid=22538): Launched 12:48:50.969546 run scp-db-to-remote(pid=22538): Terminated: ok {rc=0} 12:48:51.104572 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:48:51.422987 run patchelf(pid=22540): Launched 12:48:52.608289 run patchelf(pid=22540): Terminated: ok {rc=0} 12:48:52.743065 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:48:53.060488 run setcap-netadm(pid=22541): Launched 12:48:54.243506 run setcap-netadm(pid=22541): Terminated: ok {rc=0} 12:48:54.576196 run srsepc(pid=22542): Launched 12:48:54.695376 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:48:55.835521 run rm-remote-dir(pid=22543): Launched 12:48:56.020356 run srsepc(pid=22542): ERR: Terminated: ERROR {rc=127} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22542)] 12:48:56.160177 run srsepc(pid=22542): stdout: | (launched: 2022-12-13_12:48:54.517138) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:48:56.298330 run srsepc(pid=22542): stderr: | (launched: 2022-12-13_12:48:54.563728) | Connection to 10.42.42.116 closed. 12:48:56.436282 run srsepc(pid=22542): stdout: | (launched: 2022-12-13_12:48:54.517138) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:48:56.569167 run srsepc(pid=22542): stderr: | (launched: 2022-12-13_12:48:54.563728) | Connection to 10.42.42.116 closed. 12:48:56.726200 run rm-remote-dir(pid=22543): Terminating (SIGINT) 12:48:56.908097 run rm-remote-dir(pid=22543): Terminated: ok {rc=0} 12:48:57.038976 tst handover.py:37: ERR: Error: srsepc(pid=22542): Process ended prematurely: srsepc(pid=22542) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22542)] [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 12:48:57.049311 tst handover.py:37: Test FAILED (20.1 sec) 12:48:57.128598 run scp-back-log(pid=22544): Launched 12:48:58.207220 run scp-back-log(pid=22544): ERR: Terminated: ERROR {rc=1} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22544)] 12:48:58.268677 run scp-back-log(pid=22544): stdout: | (launched: 2022-12-13_12:48:57.096459) 12:48:58.331618 run scp-back-log(pid=22544): stderr: | (launched: 2022-12-13_12:48:57.116566) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:48:58.402531 tst srsepc_10.42.42.118: Error('scp-back-log(pid=22544): launch_sync(): local process exited with status 1 [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22544)]') ---------------------------------------------- trial-2389 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 12:48:58.448415 tst iperf3_bidir.py:13: Number of physical ue: 1 12:48:58.660071 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:48:58.702416 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 12:48:58.913296 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:48:58.929236 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:48:58.961619 tst iperf3_bidir.py: using MSISDN 8169 12:48:59.076101 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8169', subscriber_id=0} 12:48:59.185389 run srsepc_10.42.42.118: Starting srsepc 12:48:59.831219 run rm-remote-dir(pid=22546): Launched 12:49:01.035919 run rm-remote-dir(pid=22546): Terminated: ok {rc=0} 12:49:01.439737 run mk-remote-dir(pid=22547): Launched 12:49:02.672406 run mk-remote-dir(pid=22547): Terminated: ok {rc=0} 12:49:02.987601 run scp-inst-to-remote(pid=22548): Launched 12:49:05.182826 run scp-inst-to-remote(pid=22548): Terminated: ok {rc=0} 12:49:05.550449 run rm-remote-dir(pid=22550): Launched 12:49:06.748336 run rm-remote-dir(pid=22550): Terminated: ok {rc=0} 12:49:07.116645 run mk-remote-dir(pid=22551): Launched 12:49:08.313782 run mk-remote-dir(pid=22551): Terminated: ok {rc=0} 12:49:08.627546 run scp-cfg-to-remote(pid=22552): Launched 12:49:09.821121 run scp-cfg-to-remote(pid=22552): Terminated: ok {rc=0} 12:49:10.149541 run scp-db-to-remote(pid=22554): Launched 12:49:11.344840 run scp-db-to-remote(pid=22554): Terminated: ok {rc=0} 12:49:11.489446 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:49:11.828241 run patchelf(pid=22556): Launched 12:49:13.022296 run patchelf(pid=22556): Terminated: ok {rc=0} 12:49:13.166157 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:49:13.504341 run setcap-netadm(pid=22557): Launched 12:49:14.697781 run setcap-netadm(pid=22557): Terminated: ok {rc=0} 12:49:15.055597 run srsepc(pid=22558): Launched 12:49:15.181859 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:49:16.417855 run rm-remote-dir(pid=22563): Launched 12:49:16.716153 run srsepc(pid=22558): ERR: Terminated: ERROR {rc=127} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22558)] 12:49:16.880160 run srsepc(pid=22558): stdout: | (launched: 2022-12-13_12:49:14.993431) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:49:17.033180 run srsepc(pid=22558): stderr: | (launched: 2022-12-13_12:49:15.043291) | Connection to 10.42.42.116 closed. 12:49:17.184636 run srsepc(pid=22558): stdout: | (launched: 2022-12-13_12:49:14.993431) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:49:17.329161 run srsepc(pid=22558): stderr: | (launched: 2022-12-13_12:49:15.043291) | Connection to 10.42.42.116 closed. 12:49:17.498292 run rm-remote-dir(pid=22563): Terminating (SIGINT) 12:49:17.693338 run rm-remote-dir(pid=22563): Terminated: ok {rc=0} 12:49:17.834097 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=22558): Process ended prematurely: srsepc(pid=22558) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22558)] [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 12:49:17.845257 tst iperf3_bidir.py:42: Test FAILED (19.4 sec) 12:49:17.928710 run scp-back-log(pid=22564): Launched 12:49:19.013530 run scp-back-log(pid=22564): ERR: Terminated: ERROR {rc=1} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22564)] 12:49:19.077888 run scp-back-log(pid=22564): stdout: | (launched: 2022-12-13_12:49:17.895275) 12:49:19.144763 run scp-back-log(pid=22564): stderr: | (launched: 2022-12-13_12:49:17.916367) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:49:19.219423 tst srsepc_10.42.42.118: Error('scp-back-log(pid=22564): launch_sync(): local process exited with status 1 [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22564)]') ---------------------------------------------- trial-2389 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 12:49:19.267517 tst iperf3_dl.py:13: Number of physical ue: 1 12:49:19.496925 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:49:19.543621 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 12:49:19.770423 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:49:19.787153 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:49:19.823846 tst iperf3_dl.py: using MSISDN 8170 12:49:19.947382 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8170', subscriber_id=0} 12:49:20.065644 run srsepc_10.42.42.118: Starting srsepc 12:49:20.756878 run rm-remote-dir(pid=22566): Launched 12:49:21.942585 run rm-remote-dir(pid=22566): Terminated: ok {rc=0} 12:49:22.289302 run mk-remote-dir(pid=22567): Launched 12:49:23.474925 run mk-remote-dir(pid=22567): Terminated: ok {rc=0} 12:49:23.769998 run scp-inst-to-remote(pid=22568): Launched 12:49:25.958970 run scp-inst-to-remote(pid=22568): Terminated: ok {rc=0} 12:49:26.326745 run rm-remote-dir(pid=22570): Launched 12:49:27.524302 run rm-remote-dir(pid=22570): Terminated: ok {rc=0} 12:49:27.893015 run mk-remote-dir(pid=22571): Launched 12:49:29.090407 run mk-remote-dir(pid=22571): Terminated: ok {rc=0} 12:49:29.404222 run scp-cfg-to-remote(pid=22572): Launched 12:49:30.598906 run scp-cfg-to-remote(pid=22572): Terminated: ok {rc=0} 12:49:30.920543 run scp-db-to-remote(pid=22574): Launched 12:49:32.186053 run scp-db-to-remote(pid=22574): Terminated: ok {rc=0} 12:49:32.335049 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:49:32.677386 run patchelf(pid=22576): Launched 12:49:33.872264 run patchelf(pid=22576): Terminated: ok {rc=0} 12:49:34.017177 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:49:34.357474 run setcap-netadm(pid=22577): Launched 12:49:35.553201 run setcap-netadm(pid=22577): Terminated: ok {rc=0} 12:49:35.909841 run srsepc(pid=22578): Launched 12:49:36.036658 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:49:37.245738 run rm-remote-dir(pid=22579): Launched 12:49:37.439012 run srsepc(pid=22578): ERR: Terminated: ERROR {rc=127} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22578)] 12:49:37.586152 run srsepc(pid=22578): stdout: | (launched: 2022-12-13_12:49:35.847488) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:49:37.733991 run srsepc(pid=22578): stderr: | (launched: 2022-12-13_12:49:35.897542) | Connection to 10.42.42.116 closed. 12:49:37.882002 run srsepc(pid=22578): stdout: | (launched: 2022-12-13_12:49:35.847488) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:49:38.024143 run srsepc(pid=22578): stderr: | (launched: 2022-12-13_12:49:35.897542) | Connection to 10.42.42.116 closed. 12:49:38.191861 run rm-remote-dir(pid=22579): Terminating (SIGINT) 12:49:38.386619 run rm-remote-dir(pid=22579): Terminated: ok {rc=0} 12:49:38.527652 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=22578): Process ended prematurely: srsepc(pid=22578) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22578)] [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 12:49:38.538584 tst iperf3_dl.py:42: Test FAILED (19.3 sec) 12:49:38.623296 run scp-back-log(pid=22580): Launched 12:49:39.706937 run scp-back-log(pid=22580): ERR: Terminated: ERROR {rc=1} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22580)] 12:49:39.772532 run scp-back-log(pid=22580): stdout: | (launched: 2022-12-13_12:49:38.588813) 12:49:39.838891 run scp-back-log(pid=22580): stderr: | (launched: 2022-12-13_12:49:38.609891) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:49:39.913500 tst srsepc_10.42.42.118: Error('scp-back-log(pid=22580): launch_sync(): local process exited with status 1 [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22580)]') ---------------------------------------------- trial-2389 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 12:49:39.961351 tst iperf3_ul.py:13: Number of physical ue: 1 12:49:40.190948 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:49:40.234950 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 12:49:40.464393 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:49:40.481359 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:49:40.514383 tst iperf3_ul.py: using MSISDN 8171 12:49:40.637585 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8171', subscriber_id=0} 12:49:40.756839 run srsepc_10.42.42.118: Starting srsepc 12:49:41.447327 run rm-remote-dir(pid=22582): Launched 12:49:42.644188 run rm-remote-dir(pid=22582): Terminated: ok {rc=0} 12:49:43.013552 run mk-remote-dir(pid=22583): Launched 12:49:44.209198 run mk-remote-dir(pid=22583): Terminated: ok {rc=0} 12:49:44.523986 run scp-inst-to-remote(pid=22584): Launched 12:49:46.717389 run scp-inst-to-remote(pid=22584): Terminated: ok {rc=0} 12:49:47.092996 run rm-remote-dir(pid=22586): Launched 12:49:48.371435 run rm-remote-dir(pid=22586): Terminated: ok {rc=0} 12:49:48.741191 run mk-remote-dir(pid=22587): Launched 12:49:49.939245 run mk-remote-dir(pid=22587): Terminated: ok {rc=0} 12:49:50.252884 run scp-cfg-to-remote(pid=22588): Launched 12:49:51.447416 run scp-cfg-to-remote(pid=22588): Terminated: ok {rc=0} 12:49:51.759894 run scp-db-to-remote(pid=22590): Launched 12:49:52.953935 run scp-db-to-remote(pid=22590): Terminated: ok {rc=0} 12:49:53.098020 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:49:53.436540 run patchelf(pid=22592): Launched 12:49:54.631594 run patchelf(pid=22592): Terminated: ok {rc=0} 12:49:54.776085 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:49:55.115599 run setcap-netadm(pid=22593): Launched 12:49:56.309845 run setcap-netadm(pid=22593): Terminated: ok {rc=0} 12:49:56.665457 run srsepc(pid=22594): Launched 12:49:56.793538 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:49:58.005780 run rm-remote-dir(pid=22595): Launched 12:49:58.199327 run srsepc(pid=22594): ERR: Terminated: ERROR {rc=127} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22594)] 12:49:58.346871 run srsepc(pid=22594): stdout: | (launched: 2022-12-13_12:49:56.603167) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:49:58.494849 run srsepc(pid=22594): stderr: | (launched: 2022-12-13_12:49:56.653009) | Connection to 10.42.42.116 closed. 12:49:58.643786 run srsepc(pid=22594): stdout: | (launched: 2022-12-13_12:49:56.603167) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:49:58.786802 run srsepc(pid=22594): stderr: | (launched: 2022-12-13_12:49:56.653009) | Connection to 10.42.42.116 closed. 12:49:58.956225 run rm-remote-dir(pid=22595): Terminating (SIGINT) 12:49:59.151586 run rm-remote-dir(pid=22595): Terminated: ok {rc=0} 12:49:59.292658 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=22594): Process ended prematurely: srsepc(pid=22594) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22594)] [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 12:49:59.303848 tst iperf3_ul.py:42: Test FAILED (19.3 sec) 12:49:59.387424 run scp-back-log(pid=22596): Launched 12:50:00.471065 run scp-back-log(pid=22596): ERR: Terminated: ERROR {rc=1} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22596)] 12:50:00.537086 run scp-back-log(pid=22596): stdout: | (launched: 2022-12-13_12:49:59.353974) 12:50:00.604117 run scp-back-log(pid=22596): stderr: | (launched: 2022-12-13_12:49:59.374988) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:50:00.679101 tst srsepc_10.42.42.118: Error('scp-back-log(pid=22596): launch_sync(): local process exited with status 1 [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22596)]') ---------------------------------------------- trial-2389 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 12:50:00.728319 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:50:00.746764 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:50:00.771810 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:50:00.822998 tst ping.py: using MSISDN 8172 12:50:00.969406 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8172', subscriber_id=0} 12:50:01.091341 run srsepc_10.42.42.118: Starting srsepc 12:50:01.806126 run rm-remote-dir(pid=22602): Launched 12:50:03.080311 run rm-remote-dir(pid=22602): Terminated: ok {rc=0} 12:50:03.448850 run mk-remote-dir(pid=22609): Launched 12:50:04.644910 run mk-remote-dir(pid=22609): Terminated: ok {rc=0} 12:50:04.959528 run scp-inst-to-remote(pid=22610): Launched 12:50:07.156076 run scp-inst-to-remote(pid=22610): Terminated: ok {rc=0} 12:50:07.524893 run rm-remote-dir(pid=22612): Launched 12:50:08.720809 run rm-remote-dir(pid=22612): Terminated: ok {rc=0} 12:50:09.089967 run mk-remote-dir(pid=22614): Launched 12:50:10.287817 run mk-remote-dir(pid=22614): Terminated: ok {rc=0} 12:50:10.601676 run scp-cfg-to-remote(pid=22615): Launched 12:50:11.796506 run scp-cfg-to-remote(pid=22615): Terminated: ok {rc=0} 12:50:12.108901 run scp-db-to-remote(pid=22617): Launched 12:50:13.302964 run scp-db-to-remote(pid=22617): Terminated: ok {rc=0} 12:50:13.444457 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:50:13.769986 run patchelf(pid=22811): Launched 12:50:14.975019 run patchelf(pid=22811): Terminated: ok {rc=0} 12:50:15.118362 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:50:15.456701 run setcap-netadm(pid=22972): Launched 12:50:16.664539 run setcap-netadm(pid=22972): Terminated: ok {rc=0} 12:50:17.091271 run srsepc(pid=22973): Launched 12:50:17.271409 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:50:18.487113 run rm-remote-dir(pid=22974): Launched 12:50:18.680535 run srsepc(pid=22973): ERR: Terminated: ERROR {rc=127} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22973)] 12:50:18.829413 run srsepc(pid=22973): stdout: | (launched: 2022-12-13_12:50:17.028648) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:50:18.977675 run srsepc(pid=22973): stderr: | (launched: 2022-12-13_12:50:17.079537) | Connection to 10.42.42.116 closed. 12:50:19.126321 run srsepc(pid=22973): stdout: | (launched: 2022-12-13_12:50:17.028648) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:50:19.268851 run srsepc(pid=22973): stderr: | (launched: 2022-12-13_12:50:17.079537) | Connection to 10.42.42.116 closed. 12:50:19.437805 run rm-remote-dir(pid=22974): Terminating (SIGINT) 12:50:19.633078 run rm-remote-dir(pid=22974): Terminated: ok {rc=0} 12:50:19.773760 tst ping.py:16: ERR: Error: srsepc(pid=22973): Process ended prematurely: srsepc(pid=22973) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22973)] [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 12:50:19.784894 tst ping.py:16: Test FAILED (19.0 sec) 12:50:19.868544 run scp-back-log(pid=22975): Launched 12:50:20.951748 run scp-back-log(pid=22975): ERR: Terminated: ERROR {rc=1} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22975)] 12:50:21.016744 run scp-back-log(pid=22975): stdout: | (launched: 2022-12-13_12:50:19.835232) 12:50:21.083020 run scp-back-log(pid=22975): stderr: | (launched: 2022-12-13_12:50:19.856111) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:50:21.157736 tst srsepc_10.42.42.118: Error('scp-back-log(pid=22975): launch_sync(): local process exited with status 1 [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=22975)]') ---------------------------------------------- trial-2389 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 12:50:21.206504 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:50:21.223960 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:50:21.248317 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:50:21.300377 tst rrc_idle_mo_ping.py: using MSISDN 8173 12:50:21.426467 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8173', subscriber_id=0} 12:50:21.544644 run srsepc_10.42.42.118: Starting srsepc 12:50:22.234410 run rm-remote-dir(pid=22977): Launched 12:50:23.431381 run rm-remote-dir(pid=22977): Terminated: ok {rc=0} 12:50:23.807728 run mk-remote-dir(pid=23149): Launched 12:50:25.040691 run mk-remote-dir(pid=23149): Terminated: ok {rc=0} 12:50:25.358743 run scp-inst-to-remote(pid=23154): Launched 12:50:27.593405 run scp-inst-to-remote(pid=23154): Terminated: ok {rc=0} 12:50:27.969744 run rm-remote-dir(pid=23156): Launched 12:50:29.197641 run rm-remote-dir(pid=23156): Terminated: ok {rc=0} 12:50:29.565597 run mk-remote-dir(pid=23158): Launched 12:50:30.761648 run mk-remote-dir(pid=23158): Terminated: ok {rc=0} 12:50:31.087635 run scp-cfg-to-remote(pid=23159): Launched 12:50:32.393734 run scp-cfg-to-remote(pid=23159): Terminated: ok {rc=0} 12:50:32.705682 run scp-db-to-remote(pid=23161): Launched 12:50:33.901385 run scp-db-to-remote(pid=23161): Terminated: ok {rc=0} 12:50:34.045623 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:50:34.383697 run patchelf(pid=23163): Launched 12:50:35.576803 run patchelf(pid=23163): Terminated: ok {rc=0} 12:50:35.720672 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:50:36.059527 run setcap-netadm(pid=23164): Launched 12:50:37.252198 run setcap-netadm(pid=23164): Terminated: ok {rc=0} 12:50:37.606082 run srsepc(pid=23165): Launched 12:50:37.731105 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:50:38.939268 run rm-remote-dir(pid=23166): Launched 12:50:39.134674 run srsepc(pid=23165): ERR: Terminated: ERROR {rc=127} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23165)] 12:50:39.281646 run srsepc(pid=23165): stdout: | (launched: 2022-12-13_12:50:37.543751) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:50:39.429448 run srsepc(pid=23165): stderr: | (launched: 2022-12-13_12:50:37.593708) | Connection to 10.42.42.116 closed. 12:50:39.577234 run srsepc(pid=23165): stdout: | (launched: 2022-12-13_12:50:37.543751) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:50:39.719357 run srsepc(pid=23165): stderr: | (launched: 2022-12-13_12:50:37.593708) | Connection to 10.42.42.116 closed. 12:50:39.887764 run rm-remote-dir(pid=23166): Terminating (SIGINT) 12:50:40.082622 run rm-remote-dir(pid=23166): Terminated: ok {rc=0} 12:50:40.222606 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=23165): Process ended prematurely: srsepc(pid=23165) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23165)] [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 12:50:40.233691 tst rrc_idle_mo_ping.py:16: Test FAILED (19.0 sec) 12:50:40.316926 run scp-back-log(pid=23167): Launched 12:50:41.399963 run scp-back-log(pid=23167): ERR: Terminated: ERROR {rc=1} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23167)] 12:50:41.464700 run scp-back-log(pid=23167): stdout: | (launched: 2022-12-13_12:50:40.283594) 12:50:41.530834 run scp-back-log(pid=23167): stderr: | (launched: 2022-12-13_12:50:40.304438) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:50:41.605630 tst srsepc_10.42.42.118: Error('scp-back-log(pid=23167): launch_sync(): local process exited with status 1 [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23167)]') ---------------------------------------------- trial-2389 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 12:50:41.654473 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:50:41.672884 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:50:41.698304 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:50:41.753307 tst rrc_idle_mt_ping.py: using MSISDN 8174 12:50:41.879735 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8174', subscriber_id=0} 12:50:42.014714 run srsepc_10.42.42.118: Starting srsepc 12:50:42.659992 run rm-remote-dir(pid=23169): Launched 12:50:43.847262 run rm-remote-dir(pid=23169): Terminated: ok {rc=0} 12:50:44.193711 run mk-remote-dir(pid=23170): Launched 12:50:45.380101 run mk-remote-dir(pid=23170): Terminated: ok {rc=0} 12:50:45.674711 run scp-inst-to-remote(pid=23171): Launched 12:50:47.859808 run scp-inst-to-remote(pid=23171): Terminated: ok {rc=0} 12:50:48.204855 run rm-remote-dir(pid=23173): Launched 12:50:49.392131 run rm-remote-dir(pid=23173): Terminated: ok {rc=0} 12:50:49.738047 run mk-remote-dir(pid=23174): Launched 12:50:50.923555 run mk-remote-dir(pid=23174): Terminated: ok {rc=0} 12:50:51.218567 run scp-cfg-to-remote(pid=23175): Launched 12:50:52.401793 run scp-cfg-to-remote(pid=23175): Terminated: ok {rc=0} 12:50:52.696626 run scp-db-to-remote(pid=23178): Launched 12:50:53.880238 run scp-db-to-remote(pid=23178): Terminated: ok {rc=0} 12:50:54.014888 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:50:54.332899 run patchelf(pid=23180): Launched 12:50:55.517066 run patchelf(pid=23180): Terminated: ok {rc=0} 12:50:55.652150 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:50:55.969530 run setcap-netadm(pid=23181): Launched 12:50:57.152167 run setcap-netadm(pid=23181): Terminated: ok {rc=0} 12:50:57.484925 run srsepc(pid=23182): Launched 12:50:57.603188 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:50:58.768381 run rm-remote-dir(pid=23183): Launched 12:50:58.951603 run srsepc(pid=23182): ERR: Terminated: ERROR {rc=127} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23182)] 12:50:59.091101 run srsepc(pid=23182): stdout: | (launched: 2022-12-13_12:50:57.426098) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:50:59.229082 run srsepc(pid=23182): stderr: | (launched: 2022-12-13_12:50:57.472645) | Connection to 10.42.42.116 closed. 12:50:59.366723 run srsepc(pid=23182): stdout: | (launched: 2022-12-13_12:50:57.426098) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:50:59.498874 run srsepc(pid=23182): stderr: | (launched: 2022-12-13_12:50:57.472645) | Connection to 10.42.42.116 closed. 12:50:59.655321 run rm-remote-dir(pid=23183): Terminating (SIGINT) 12:50:59.836728 run rm-remote-dir(pid=23183): Terminated: ok {rc=0} 12:50:59.967547 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=23182): Process ended prematurely: srsepc(pid=23182) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23182)] [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 12:50:59.977777 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 12:51:00.058359 run scp-back-log(pid=23184): Launched 12:51:01.135223 run scp-back-log(pid=23184): ERR: Terminated: ERROR {rc=1} [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23184)] 12:51:01.198988 run scp-back-log(pid=23184): stdout: | (launched: 2022-12-13_12:51:00.025187) 12:51:01.263446 run scp-back-log(pid=23184): stderr: | (launched: 2022-12-13_12:51:00.045488) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:51:01.336318 tst srsepc_10.42.42.118: Error('scp-back-log(pid=23184): launch_sync(): local process exited with status 1 [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23184)]') --------------------------------------------------------------------- trial-2389 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 12:51:01.493954 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:51:01.500098 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 12:51:01.546045 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 12:51:01.575790 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 12:51:01.634711 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 12:51:01.697366 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 12:51:01.731980 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 12:51:02.255225 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 12:51:02.261454 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:51:02.272713 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 12:51:02.311090 tst handover.py: using LAC 34053 12:51:02.436479 tst handover.py: using RAC 138 12:51:02.558267 tst handover.py: using CellId 34053 12:51:02.690980 tst handover.py: using BVCI 34054 12:51:02.811946 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 12:51:02.848890 tst handover.py: using LAC 34054 12:51:02.980868 tst handover.py: using RAC 139 12:51:03.111594 tst handover.py: using CellId 34054 12:51:03.235074 tst handover.py: using BVCI 34055 12:51:03.347321 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:51:03.358201 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:51:03.368792 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:51:03.379456 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:51:03.390299 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:51:03.400868 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 12:51:03.517841 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 12:51:03.637038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:04.159427 run create_hlr_db(pid=23190): Launched 12:51:05.354351 run create_hlr_db(pid=23190): Terminated: ok {rc=0} 12:51:05.705226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23192): Launched 12:51:06.037737 run osmo-hlr_10.42.42.2(pid=23193): Launched 12:51:06.165409 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:06.736292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23195): Launched 12:51:07.071338 run osmo-stp_10.42.42.5(pid=23196): Launched 12:51:07.200428 run osmo-msc_10.42.42.6: Starting osmo-msc 12:51:07.801832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23198): Launched 12:51:08.113928 run osmo-msc_10.42.42.6(pid=23199): Launched 12:51:08.290084 run osmo-stp_10.42.42.5(pid=23196): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23196)] 12:51:08.421986 run osmo-stp_10.42.42.5(pid=23196): stdout: | (launched: 2022-12-13_12:51:07.009904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:08.554076 run osmo-stp_10.42.42.5(pid=23196): stderr: | 20221213125107202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125107202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125107203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125107203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125107204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125107204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125107204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:08.684003 run osmo-stp_10.42.42.5(pid=23196): stdout: | (launched: 2022-12-13_12:51:07.009904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:08.807890 run osmo-stp_10.42.42.5(pid=23196): stderr: | 20221213125107202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125107202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125107203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125107203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125107204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125107204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125107204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:08.955767 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23196): Process ended prematurely: osmo-stp_10.42.42.5(pid=23196) [trial-2389↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23196)] [trial-2389↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 12:51:08.964381 tst handover.py:18: Test FAILED (6.7 sec) 12:51:08.991143 run osmo-hlr_10.42.42.2(pid=23193): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23193)] 12:51:09.040518 run osmo-hlr_10.42.42.2(pid=23193): stdout: | (launched: 2022-12-13_12:51:05.976391) 12:51:09.090835 run osmo-hlr_10.42.42.2(pid=23193): stderr: | 20221213125106176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125106176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125106176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125106176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125106176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125106176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125106188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125106197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125106197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125106197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:09.161907 run osmo-msc_10.42.42.6(pid=23199): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23199)] 12:51:09.209908 run osmo-msc_10.42.42.6(pid=23199): stdout: | (launched: 2022-12-13_12:51:08.056039) 12:51:09.260057 run osmo-msc_10.42.42.6(pid=23199): stderr: | 20221213125108328 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125108328 DLGLOBAL DEBUG validating counter group 0x7fa278fccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125108328 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125108328 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125108328 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125108328 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125108330 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125108331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125108331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125108331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:51:09.310428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23192): Terminating (SIGTERM) 12:51:09.350817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23195): Terminating (SIGTERM) 12:51:09.391302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23198): Terminating (SIGTERM) 12:51:09.432722 --- ParallelTerminationStrategy: PID 23192 died... 12:51:09.452602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23192): Terminated: ok {rc=0} 12:51:09.497836 --- ParallelTerminationStrategy: PID 23195 died... 12:51:09.517213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23195): Terminated: ok {rc=0} 12:51:09.561908 --- ParallelTerminationStrategy: PID 23198 died... 12:51:09.580831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23198): Terminated: ok {rc=0} 12:51:09.669096 bus /sierra_3: Setting Powered False 12:51:10.769097 bus /sierra_3: Setting Powered False 12:51:11.886727 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 12:51:13.144360 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:51:13.149770 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 12:51:13.191386 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 12:51:13.219331 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 12:51:13.272297 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 12:51:13.313347 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 12:51:13.341130 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 12:51:13.901272 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 12:51:13.906667 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:51:13.918081 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 12:51:13.956694 tst handover.py: using LAC 34055 12:51:14.092845 tst handover.py: using RAC 140 12:51:14.226284 tst handover.py: using CellId 34055 12:51:14.354062 tst handover.py: using BVCI 34056 12:51:14.468740 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 12:51:14.501639 tst handover.py: using LAC 34056 12:51:14.622918 tst handover.py: using RAC 141 12:51:14.746270 tst handover.py: using CellId 34056 12:51:14.870212 tst handover.py: using BVCI 34057 12:51:14.983255 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:51:14.994421 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:51:15.005420 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:51:15.016188 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:51:15.028059 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:51:15.039726 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 12:51:15.160910 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 12:51:15.282596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:15.766279 run create_hlr_db(pid=23205): Launched 12:51:15.919796 bus /sierra_2: Setting Powered False 12:51:16.982656 run create_hlr_db(pid=23205): Terminated: ok {rc=0} 12:51:17.424005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23207): Launched 12:51:17.758134 run osmo-hlr_10.42.42.2(pid=23208): Launched 12:51:17.880403 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:18.399038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23210): Launched 12:51:18.712214 run osmo-stp_10.42.42.5(pid=23211): Launched 12:51:18.832782 run osmo-msc_10.42.42.6: Starting osmo-msc 12:51:19.369068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23213): Launched 12:51:19.682864 run osmo-msc_10.42.42.6(pid=23214): Launched 12:51:19.856857 run osmo-stp_10.42.42.5(pid=23211): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23211)] 12:51:19.988074 run osmo-stp_10.42.42.5(pid=23211): stdout: | (launched: 2022-12-13_12:51:18.654356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:20.120299 run osmo-stp_10.42.42.5(pid=23211): stderr: | 20221213125118829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125118829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125118830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125118830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125118831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125118831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125118831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:20.250450 run osmo-stp_10.42.42.5(pid=23211): stdout: | (launched: 2022-12-13_12:51:18.654356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:20.374467 run osmo-stp_10.42.42.5(pid=23211): stderr: | 20221213125118829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125118829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125118830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125118830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125118831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125118831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125118831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:20.522813 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23211): Process ended prematurely: osmo-stp_10.42.42.5(pid=23211) [trial-2389↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23211)] [trial-2389↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 12:51:20.531510 tst handover.py:18: Test FAILED (6.6 sec) 12:51:20.558037 run osmo-hlr_10.42.42.2(pid=23208): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23208)] 12:51:20.606691 run osmo-hlr_10.42.42.2(pid=23208): stdout: | (launched: 2022-12-13_12:51:17.696691) 12:51:20.656655 run osmo-hlr_10.42.42.2(pid=23208): stderr: | 20221213125117881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125117881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125117881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125117881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125117881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125117881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125117899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125117909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125117910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125117910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:20.726909 run osmo-msc_10.42.42.6(pid=23214): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23214)] 12:51:20.774785 run osmo-msc_10.42.42.6(pid=23214): stdout: | (launched: 2022-12-13_12:51:19.624809) 12:51:20.824533 run osmo-msc_10.42.42.6(pid=23214): stderr: | 20221213125119901 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125119901 DLGLOBAL DEBUG validating counter group 0x7fd1d020ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125119901 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125119901 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125119901 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125119901 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125119903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125119903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125119904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125119904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:51:20.874559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23207): Terminating (SIGTERM) 12:51:20.915098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23210): Terminating (SIGTERM) 12:51:20.955580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23213): Terminating (SIGTERM) 12:51:20.997460 --- ParallelTerminationStrategy: PID 23207 died... 12:51:21.017171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23207): Terminated: ok {rc=0} 12:51:21.062627 --- ParallelTerminationStrategy: PID 23210 died... 12:51:21.081728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23210): Terminated: ok {rc=0} 12:51:21.126647 --- ParallelTerminationStrategy: PID 23213 died... 12:51:21.146037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23213): Terminated: ok {rc=0} 12:51:21.235046 bus /sierra_3: Setting Powered False 12:51:22.336493 bus /sierra_3: Setting Powered False 12:51:23.451716 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 12:51:24.709815 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:51:24.716502 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:51:24.772354 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:51:24.800326 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:51:24.852891 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:51:24.909233 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:51:24.936781 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:51:25.490575 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 12:51:25.496370 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:51:25.507973 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:51:25.548121 tst handover.py: using LAC 34057 12:51:25.678684 tst handover.py: using RAC 142 12:51:25.815653 tst handover.py: using CellId 34057 12:51:25.945705 tst handover.py: using BVCI 34058 12:51:26.066925 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:51:26.115565 tst handover.py: using LAC 34058 12:51:26.247444 tst handover.py: using RAC 143 12:51:26.377124 tst handover.py: using CellId 34058 12:51:26.505374 tst handover.py: using BVCI 34059 12:51:26.625629 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:51:26.637125 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:51:26.648373 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:51:26.659728 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:51:26.671088 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:51:26.682330 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:51:26.800614 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:51:26.921628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:27.408553 run create_hlr_db(pid=23219): Launched 12:51:27.543970 bus /sierra_2: Setting Powered False 12:51:28.610054 run create_hlr_db(pid=23219): Terminated: ok {rc=0} 12:51:29.027568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23221): Launched 12:51:29.340162 run osmo-hlr_10.42.42.2(pid=23222): Launched 12:51:29.459314 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:29.980524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23224): Launched 12:51:30.291989 run osmo-stp_10.42.42.5(pid=23225): Launched 12:51:30.412147 run osmo-msc_10.42.42.6: Starting osmo-msc 12:51:30.978369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23227): Launched 12:51:31.313716 run osmo-msc_10.42.42.6(pid=23228): Launched 12:51:31.891841 run osmo-stp_10.42.42.5(pid=23225): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23225)] 12:51:32.252299 run osmo-stp_10.42.42.5(pid=23225): stdout: | (launched: 2022-12-13_12:51:30.234348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:32.396145 run osmo-stp_10.42.42.5(pid=23225): stderr: | 20221213125130408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125130408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125130408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125130409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125130409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125130409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125130410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:32.534515 run osmo-stp_10.42.42.5(pid=23225): stdout: | (launched: 2022-12-13_12:51:30.234348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:32.666201 run osmo-stp_10.42.42.5(pid=23225): stderr: | 20221213125130408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125130408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125130408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125130409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125130409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125130409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125130410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:32.824666 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23225): Process ended prematurely: osmo-stp_10.42.42.5(pid=23225) [trial-2389↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23225)] [trial-2389↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 12:51:32.833995 tst handover.py:18: Test FAILED (7.3 sec) 12:51:32.862101 run osmo-hlr_10.42.42.2(pid=23222): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23222)] 12:51:32.912904 run osmo-hlr_10.42.42.2(pid=23222): stdout: | (launched: 2022-12-13_12:51:29.281743) 12:51:32.965637 run osmo-hlr_10.42.42.2(pid=23222): stderr: | 20221213125129460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125129460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125129460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125129460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125129460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125129460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125129471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125129479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125129480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125129480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:33.038633 run osmo-msc_10.42.42.6(pid=23228): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23228)] 12:51:33.088902 run osmo-msc_10.42.42.6(pid=23228): stdout: | (launched: 2022-12-13_12:51:31.249646) 12:51:33.141082 run osmo-msc_10.42.42.6(pid=23228): stderr: | 20221213125131855 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125131856 DLGLOBAL DEBUG validating counter group 0x7ff659fedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125131856 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125131856 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125131857 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125131858 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125131862 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125131862 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125131863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125131864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:51:33.193527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23221): Terminating (SIGTERM) 12:51:33.235612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23224): Terminating (SIGTERM) 12:51:33.278126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23227): Terminating (SIGTERM) 12:51:33.321269 --- ParallelTerminationStrategy: PID 23221 died... 12:51:33.342188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23221): Terminated: ok {rc=0} 12:51:33.389695 --- ParallelTerminationStrategy: PID 23224 died... 12:51:33.409873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23224): Terminated: ok {rc=0} 12:51:33.456793 --- ParallelTerminationStrategy: PID 23227 died... 12:51:33.476930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23227): Terminated: ok {rc=0} 12:51:33.567433 bus /sierra_3: Setting Powered False 12:51:34.667163 bus /sierra_3: Setting Powered False 12:51:35.785070 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:51:37.044508 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:51:37.049764 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:51:37.100276 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:51:37.126737 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:51:37.178709 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:51:37.228672 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:51:37.255411 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:51:37.814292 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:51:37.820128 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:51:37.832060 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:51:37.873298 tst handover.py: using LAC 34059 12:51:38.008077 tst handover.py: using RAC 144 12:51:38.142851 tst handover.py: using CellId 34059 12:51:38.272359 tst handover.py: using BVCI 34060 12:51:38.394740 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:51:38.439694 tst handover.py: using LAC 34060 12:51:38.561460 tst handover.py: using RAC 145 12:51:38.683970 tst handover.py: using CellId 34060 12:51:38.805086 tst handover.py: using BVCI 34061 12:51:38.917948 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:51:38.929377 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:51:38.940480 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:51:38.951613 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:51:38.963472 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:51:38.975363 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:51:39.099619 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:51:39.218166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:39.673103 run create_hlr_db(pid=23234): Launched 12:51:39.790937 bus /sierra_2: Setting Powered False 12:51:40.852475 run create_hlr_db(pid=23234): Terminated: ok {rc=0} 12:51:41.258734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23236): Launched 12:51:41.572487 run osmo-hlr_10.42.42.2(pid=23237): Launched 12:51:41.693331 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:42.216445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23239): Launched 12:51:42.527782 run osmo-stp_10.42.42.5(pid=23240): Launched 12:51:42.647579 run osmo-msc_10.42.42.6: Starting osmo-msc 12:51:43.185824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23242): Launched 12:51:43.500180 run osmo-msc_10.42.42.6(pid=23243): Launched 12:51:43.675101 run osmo-stp_10.42.42.5(pid=23240): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23240)] 12:51:43.807271 run osmo-stp_10.42.42.5(pid=23240): stdout: | (launched: 2022-12-13_12:51:42.469826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:43.938671 run osmo-stp_10.42.42.5(pid=23240): stderr: | 20221213125142643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125142643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125142643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125142644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125142644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125142644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125142644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:44.068052 run osmo-stp_10.42.42.5(pid=23240): stdout: | (launched: 2022-12-13_12:51:42.469826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:44.191423 run osmo-stp_10.42.42.5(pid=23240): stderr: | 20221213125142643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125142643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125142643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125142644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125142644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125142644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125142644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:44.339371 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23240): Process ended prematurely: osmo-stp_10.42.42.5(pid=23240) [trial-2389↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23240)] [trial-2389↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 12:51:44.347851 tst handover.py:18: Test FAILED (6.5 sec) 12:51:44.374033 run osmo-hlr_10.42.42.2(pid=23237): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23237)] 12:51:44.422214 run osmo-hlr_10.42.42.2(pid=23237): stdout: | (launched: 2022-12-13_12:51:41.514429) 12:51:44.472180 run osmo-hlr_10.42.42.2(pid=23237): stderr: | 20221213125141695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125141695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125141695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125141695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125141695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125141695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125141707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125141716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125141716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125141716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:44.541785 run osmo-msc_10.42.42.6(pid=23243): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23243)] 12:51:44.589454 run osmo-msc_10.42.42.6(pid=23243): stdout: | (launched: 2022-12-13_12:51:43.442050) 12:51:44.639220 run osmo-msc_10.42.42.6(pid=23243): stderr: | 20221213125143713 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125143714 DLGLOBAL DEBUG validating counter group 0x7f5cc9fa0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125143714 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125143714 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125143714 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125143714 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125143716 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125143716 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125143716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125143716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:51:44.689358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23236): Terminating (SIGTERM) 12:51:44.729567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23239): Terminating (SIGTERM) 12:51:44.769809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23242): Terminating (SIGTERM) 12:51:44.810244 --- ParallelTerminationStrategy: PID 23236 died... 12:51:44.829771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23236): Terminated: ok {rc=0} 12:51:44.874378 --- ParallelTerminationStrategy: PID 23239 died... 12:51:44.893299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23239): Terminated: ok {rc=0} 12:51:44.937693 --- ParallelTerminationStrategy: PID 23242 died... 12:51:44.956647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23242): Terminated: ok {rc=0} 12:51:45.041406 bus /sierra_3: Setting Powered False 12:51:46.143278 bus /sierra_3: Setting Powered False 12:51:47.273241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:51:48.532044 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:51:48.537234 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:51:48.592714 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:51:48.619366 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:51:48.672226 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:51:48.728622 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:51:48.756257 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:51:49.304910 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:51:49.310391 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:51:49.321494 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:51:49.358616 tst handover.py: using LAC 34061 12:51:49.483652 tst handover.py: using RAC 146 12:51:49.606037 tst handover.py: using CellId 34061 12:51:49.730632 tst handover.py: using BVCI 34062 12:51:49.844685 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:51:49.894354 tst handover.py: using LAC 34062 12:51:50.024613 tst handover.py: using RAC 147 12:51:50.154941 tst handover.py: using CellId 34062 12:51:50.285769 tst handover.py: using BVCI 34063 12:51:50.402315 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:51:50.413683 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:51:50.424518 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:51:50.435718 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:51:50.447349 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:51:50.459206 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:51:50.580713 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:51:50.699659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:51.153684 run create_hlr_db(pid=23248): Launched 12:51:51.273615 bus /sierra_2: Setting Powered False 12:51:52.335605 run create_hlr_db(pid=23248): Terminated: ok {rc=0} 12:51:52.742120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23250): Launched 12:51:53.054850 run osmo-hlr_10.42.42.2(pid=23251): Launched 12:51:53.175458 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:53.699256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23253): Launched 12:51:54.012573 run osmo-stp_10.42.42.5(pid=23254): Launched 12:51:54.133268 run osmo-msc_10.42.42.6: Starting osmo-msc 12:51:54.682755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23256): Launched 12:51:54.996299 run osmo-msc_10.42.42.6(pid=23257): Launched 12:51:55.171172 run osmo-stp_10.42.42.5(pid=23254): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23254)] 12:51:55.302849 run osmo-stp_10.42.42.5(pid=23254): stdout: | (launched: 2022-12-13_12:51:53.954424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:55.434375 run osmo-stp_10.42.42.5(pid=23254): stderr: | 20221213125154132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125154133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125154133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125154133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125154134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125154134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125154134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:55.564478 run osmo-stp_10.42.42.5(pid=23254): stdout: | (launched: 2022-12-13_12:51:53.954424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:55.688320 run osmo-stp_10.42.42.5(pid=23254): stderr: | 20221213125154132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125154133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125154133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125154133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125154134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125154134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125154134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:55.836280 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23254): Process ended prematurely: osmo-stp_10.42.42.5(pid=23254) [trial-2389↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23254)] [trial-2389↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 12:51:55.844908 tst handover.py:18: Test FAILED (6.5 sec) 12:51:55.871324 run osmo-hlr_10.42.42.2(pid=23251): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23251)] 12:51:55.920420 run osmo-hlr_10.42.42.2(pid=23251): stdout: | (launched: 2022-12-13_12:51:52.996727) 12:51:55.971152 run osmo-hlr_10.42.42.2(pid=23251): stderr: | 20221213125153177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125153177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125153177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125153177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125153177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125153177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125153188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125153197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125153197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125153197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:56.041929 run osmo-msc_10.42.42.6(pid=23257): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23257)] 12:51:56.090224 run osmo-msc_10.42.42.6(pid=23257): stdout: | (launched: 2022-12-13_12:51:54.938385) 12:51:56.140737 run osmo-msc_10.42.42.6(pid=23257): stderr: | 20221213125155212 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125155212 DLGLOBAL DEBUG validating counter group 0x7f198fc24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125155212 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125155212 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125155213 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125155213 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125155215 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125155215 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125155215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125155215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:51:56.191383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23250): Terminating (SIGTERM) 12:51:56.232060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23253): Terminating (SIGTERM) 12:51:56.272586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23256): Terminating (SIGTERM) 12:51:56.313290 --- ParallelTerminationStrategy: PID 23250 died... 12:51:56.333157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23250): Terminated: ok {rc=0} 12:51:56.378274 --- ParallelTerminationStrategy: PID 23253 died... 12:51:56.397775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23253): Terminated: ok {rc=0} 12:51:56.443004 --- ParallelTerminationStrategy: PID 23256 died... 12:51:56.462313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23256): Terminated: ok {rc=0} 12:51:56.548205 bus /sierra_3: Setting Powered False 12:51:57.646688 bus /sierra_3: Setting Powered False 12:51:58.764794 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 12:52:00.034546 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:00.040156 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:52:00.083742 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:52:00.111479 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:52:00.165579 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:52:00.208122 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:52:00.234841 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:52:00.783725 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 12:52:00.789514 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:52:00.800445 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 12:52:00.852344 tst handover.py: using LAC 34063 12:52:00.991250 tst handover.py: using RAC 148 12:52:01.153287 tst handover.py: using CellId 34063 12:52:01.286236 tst handover.py: using BVCI 34064 12:52:01.401024 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 12:52:01.436044 tst handover.py: using LAC 34064 12:52:01.562130 tst handover.py: using RAC 149 12:52:01.731092 tst handover.py: using CellId 34064 12:52:01.854999 tst handover.py: using BVCI 34065 12:52:01.971242 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:52:01.982980 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:52:01.994629 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:52:02.006291 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:52:02.018862 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:52:02.031572 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 12:52:02.153063 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 12:52:02.273251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:02.731791 run create_hlr_db(pid=23262): Launched 12:52:02.852779 bus /sierra_2: Setting Powered False 12:52:03.914946 run create_hlr_db(pid=23262): Terminated: ok {rc=0} 12:52:04.340860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23264): Launched 12:52:04.675866 run osmo-hlr_10.42.42.2(pid=23265): Launched 12:52:04.804568 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:05.347518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23267): Launched 12:52:05.679878 run osmo-stp_10.42.42.5(pid=23268): Launched 12:52:05.807029 run osmo-msc_10.42.42.6: Starting osmo-msc 12:52:06.378858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23270): Launched 12:52:06.711959 run osmo-msc_10.42.42.6(pid=23271): Launched 12:52:06.898903 run osmo-stp_10.42.42.5(pid=23268): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23268)] 12:52:07.038111 run osmo-stp_10.42.42.5(pid=23268): stdout: | (launched: 2022-12-13_12:52:05.618582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:07.178169 run osmo-stp_10.42.42.5(pid=23268): stderr: | 20221213125205814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125205814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125205814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125205814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125205815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125205815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125205815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:07.315929 run osmo-stp_10.42.42.5(pid=23268): stdout: | (launched: 2022-12-13_12:52:05.618582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:07.448053 run osmo-stp_10.42.42.5(pid=23268): stderr: | 20221213125205814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125205814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125205814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125205814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125205815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125205815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125205815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:07.606274 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23268): Process ended prematurely: osmo-stp_10.42.42.5(pid=23268) [trial-2389↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23268)] [trial-2389↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 12:52:07.615651 tst handover.py:18: Test FAILED (6.8 sec) 12:52:07.643746 run osmo-hlr_10.42.42.2(pid=23265): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23265)] 12:52:07.694397 run osmo-hlr_10.42.42.2(pid=23265): stdout: | (launched: 2022-12-13_12:52:04.614512) 12:52:07.746156 run osmo-hlr_10.42.42.2(pid=23265): stderr: | 20221213125204815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125204815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125204815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125204815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125204815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125204815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125204831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125204841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125204841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125204841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:07.818548 run osmo-msc_10.42.42.6(pid=23271): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23271)] 12:52:07.868567 run osmo-msc_10.42.42.6(pid=23271): stdout: | (launched: 2022-12-13_12:52:06.650440) 12:52:07.920147 run osmo-msc_10.42.42.6(pid=23271): stderr: | 20221213125206974 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125206974 DLGLOBAL DEBUG validating counter group 0x7f1e558bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125206974 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125206974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125206975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125206975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125206976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125206977 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125206977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125206977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:52:07.972346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23264): Terminating (SIGTERM) 12:52:08.014251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23267): Terminating (SIGTERM) 12:52:08.056579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23270): Terminating (SIGTERM) 12:52:08.099228 --- ParallelTerminationStrategy: PID 23264 died... 12:52:08.119671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23264): Terminated: ok {rc=0} 12:52:08.166661 --- ParallelTerminationStrategy: PID 23267 died... 12:52:08.186609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23267): Terminated: ok {rc=0} 12:52:08.233248 --- ParallelTerminationStrategy: PID 23270 died... 12:52:08.253270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23270): Terminated: ok {rc=0} 12:52:08.342536 bus /sierra_3: Setting Powered False 12:52:09.443042 bus /sierra_3: Setting Powered False 12:52:10.561320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 12:52:11.815191 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:11.821620 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:52:11.877230 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:52:11.904862 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:52:11.959854 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:52:12.013971 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:52:12.040600 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:52:12.594000 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 12:52:12.599629 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:52:12.611239 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:52:12.649383 tst handover.py: using LAC 34065 12:52:12.778030 tst handover.py: using RAC 150 12:52:12.907374 tst handover.py: using CellId 34065 12:52:13.038322 tst handover.py: using BVCI 34066 12:52:13.160135 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:52:13.209221 tst handover.py: using LAC 34066 12:52:13.338468 tst handover.py: using RAC 151 12:52:13.468745 tst handover.py: using CellId 34066 12:52:13.598359 tst handover.py: using BVCI 34067 12:52:13.718732 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:52:13.730396 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:52:13.741805 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:52:13.753348 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:52:13.764858 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:52:13.776322 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:52:13.893580 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:52:14.012484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:14.465458 run create_hlr_db(pid=23276): Launched 12:52:14.587441 bus /sierra_2: Setting Powered False 12:52:15.649054 run create_hlr_db(pid=23276): Terminated: ok {rc=0} 12:52:16.061238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23278): Launched 12:52:16.451962 run osmo-hlr_10.42.42.2(pid=23279): Launched 12:52:16.711733 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:17.441749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23281): Launched 12:52:17.780259 run osmo-stp_10.42.42.5(pid=23282): Launched 12:52:17.909770 run osmo-msc_10.42.42.6: Starting osmo-msc 12:52:18.479968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23284): Launched 12:52:18.812354 run osmo-msc_10.42.42.6(pid=23285): Launched 12:52:18.997375 run osmo-stp_10.42.42.5(pid=23282): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23282)] 12:52:19.136056 run osmo-stp_10.42.42.5(pid=23282): stdout: | (launched: 2022-12-13_12:52:17.718932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:19.275513 run osmo-stp_10.42.42.5(pid=23282): stderr: | 20221213125217912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125217913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125217913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125217913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125217914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125217914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125217914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:19.414407 run osmo-stp_10.42.42.5(pid=23282): stdout: | (launched: 2022-12-13_12:52:17.718932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:19.546516 run osmo-stp_10.42.42.5(pid=23282): stderr: | 20221213125217912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125217913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125217913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125217913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125217914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125217914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125217914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:19.705195 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23282): Process ended prematurely: osmo-stp_10.42.42.5(pid=23282) [trial-2389↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23282)] [trial-2389↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 12:52:19.714581 tst handover.py:18: Test FAILED (7.1 sec) 12:52:19.742173 run osmo-hlr_10.42.42.2(pid=23279): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23279)] 12:52:19.793674 run osmo-hlr_10.42.42.2(pid=23279): stdout: | (launched: 2022-12-13_12:52:16.381670) 12:52:19.847028 run osmo-hlr_10.42.42.2(pid=23279): stderr: | 20221213125216615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125216616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125216616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125216616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125216616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125216616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125216630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125216654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125216654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125216654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:19.919547 run osmo-msc_10.42.42.6(pid=23285): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23285)] 12:52:19.969474 run osmo-msc_10.42.42.6(pid=23285): stdout: | (launched: 2022-12-13_12:52:18.751148) 12:52:20.021307 run osmo-msc_10.42.42.6(pid=23285): stderr: | 20221213125219075 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125219075 DLGLOBAL DEBUG validating counter group 0x7fb0cd1dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125219076 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125219076 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125219076 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125219076 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125219078 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125219078 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125219079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125219079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:52:20.073563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23278): Terminating (SIGTERM) 12:52:20.115410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23281): Terminating (SIGTERM) 12:52:20.157691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23284): Terminating (SIGTERM) 12:52:20.199911 --- ParallelTerminationStrategy: PID 23278 died... 12:52:20.220023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23278): Terminated: ok {rc=0} 12:52:20.266390 --- ParallelTerminationStrategy: PID 23281 died... 12:52:20.286641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23281): Terminated: ok {rc=0} 12:52:20.332810 --- ParallelTerminationStrategy: PID 23284 died... 12:52:20.353098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23284): Terminated: ok {rc=0} 12:52:20.442370 bus /sierra_3: Setting Powered False 12:52:21.539895 bus /sierra_3: Setting Powered False 12:52:22.655409 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 12:52:23.918408 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:23.923642 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:52:23.977794 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:52:24.004189 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:52:24.057353 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:52:24.111413 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:52:24.138012 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:52:24.686379 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 12:52:24.691996 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:52:24.703124 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:52:24.740121 tst handover.py: using LAC 34067 12:52:24.863785 tst handover.py: using RAC 152 12:52:24.984263 tst handover.py: using CellId 34067 12:52:25.103647 tst handover.py: using BVCI 34068 12:52:25.215777 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:52:25.261758 tst handover.py: using LAC 34068 12:52:25.383366 tst handover.py: using RAC 153 12:52:25.512447 tst handover.py: using CellId 34068 12:52:25.640183 tst handover.py: using BVCI 34069 12:52:25.761147 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:52:25.773181 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:52:25.784571 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:52:25.796008 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:52:25.807807 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:52:25.819400 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:52:25.936802 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:52:26.058537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:26.543994 run create_hlr_db(pid=23290): Launched 12:52:26.679272 bus /sierra_2: Setting Powered False 12:52:27.744472 run create_hlr_db(pid=23290): Terminated: ok {rc=0} 12:52:28.161507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23292): Launched 12:52:28.472677 run osmo-hlr_10.42.42.2(pid=23293): Launched 12:52:28.593063 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:29.115375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23295): Launched 12:52:29.426710 run osmo-stp_10.42.42.5(pid=23296): Launched 12:52:29.547760 run osmo-msc_10.42.42.6: Starting osmo-msc 12:52:30.083470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23298): Launched 12:52:30.396398 run osmo-msc_10.42.42.6(pid=23299): Launched 12:52:30.572829 run osmo-stp_10.42.42.5(pid=23296): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23296)] 12:52:30.704263 run osmo-stp_10.42.42.5(pid=23296): stdout: | (launched: 2022-12-13_12:52:29.368662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:30.836105 run osmo-stp_10.42.42.5(pid=23296): stderr: | 20221213125229542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125229542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125229543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125229543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125229544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125229544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125229544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:30.973320 run osmo-stp_10.42.42.5(pid=23296): stdout: | (launched: 2022-12-13_12:52:29.368662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:31.099566 run osmo-stp_10.42.42.5(pid=23296): stderr: | 20221213125229542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125229542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125229543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125229543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125229544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125229544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125229544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:31.251405 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23296): Process ended prematurely: osmo-stp_10.42.42.5(pid=23296) [trial-2389↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23296)] [trial-2389↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 12:52:31.260882 tst handover.py:18: Test FAILED (6.6 sec) 12:52:31.288319 run osmo-hlr_10.42.42.2(pid=23293): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23293)] 12:52:31.340192 run osmo-hlr_10.42.42.2(pid=23293): stdout: | (launched: 2022-12-13_12:52:28.414621) 12:52:31.393365 run osmo-hlr_10.42.42.2(pid=23293): stderr: | 20221213125228594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125228594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125228594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125228594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125228594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125228594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125228605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125228614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125228614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125228614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:31.465179 run osmo-msc_10.42.42.6(pid=23299): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23299)] 12:52:31.514412 run osmo-msc_10.42.42.6(pid=23299): stdout: | (launched: 2022-12-13_12:52:30.338335) 12:52:31.566652 run osmo-msc_10.42.42.6(pid=23299): stderr: | 20221213125230610 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125230610 DLGLOBAL DEBUG validating counter group 0x7f7fe10a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125230610 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125230610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125230610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125230610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125230612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125230612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125230613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125230613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:52:31.620647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23292): Terminating (SIGTERM) 12:52:31.661964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23295): Terminating (SIGTERM) 12:52:31.704106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23298): Terminating (SIGTERM) 12:52:31.745996 --- ParallelTerminationStrategy: PID 23292 died... 12:52:31.767107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23292): Terminated: ok {rc=0} 12:52:31.813849 --- ParallelTerminationStrategy: PID 23295 died... 12:52:31.834583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23295): Terminated: ok {rc=0} 12:52:31.881720 --- ParallelTerminationStrategy: PID 23298 died... 12:52:31.902642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23298): Terminated: ok {rc=0} 12:52:31.992620 bus /sierra_3: Setting Powered False 12:52:33.091472 bus /sierra_3: Setting Powered False 12:52:34.206671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 12:52:35.473875 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:35.479558 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 12:52:35.518024 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 12:52:35.545877 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 12:52:35.602529 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 12:52:35.640505 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 12:52:35.667608 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 12:52:36.213474 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 12:52:36.218972 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:52:36.230229 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 12:52:36.264774 tst handover.py: using LAC 34069 12:52:36.394165 tst handover.py: using RAC 154 12:52:36.526669 tst handover.py: using CellId 34069 12:52:36.648620 tst handover.py: using BVCI 34070 12:52:36.762130 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 12:52:36.798644 tst handover.py: using LAC 34070 12:52:36.919832 tst handover.py: using RAC 155 12:52:37.039701 tst handover.py: using CellId 34070 12:52:37.171513 tst handover.py: using BVCI 34071 12:52:37.293684 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:52:37.304836 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:52:37.316124 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:52:37.327303 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:52:37.338511 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:52:37.349831 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 12:52:37.467632 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 12:52:37.590922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:38.078175 run create_hlr_db(pid=23304): Launched 12:52:38.214152 bus /sierra_2: Setting Powered False 12:52:39.279778 run create_hlr_db(pid=23304): Terminated: ok {rc=0} 12:52:39.698541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23306): Launched 12:52:40.013213 run osmo-hlr_10.42.42.2(pid=23307): Launched 12:52:40.134013 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:40.658480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23309): Launched 12:52:40.971478 run osmo-stp_10.42.42.5(pid=23310): Launched 12:52:41.092549 run osmo-msc_10.42.42.6: Starting osmo-msc 12:52:41.627565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23312): Launched 12:52:41.941646 run osmo-msc_10.42.42.6(pid=23313): Launched 12:52:42.118896 run osmo-stp_10.42.42.5(pid=23310): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23310)] 12:52:42.251063 run osmo-stp_10.42.42.5(pid=23310): stdout: | (launched: 2022-12-13_12:52:40.913347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:42.382924 run osmo-stp_10.42.42.5(pid=23310): stderr: | 20221213125241087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125241087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125241087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125241087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125241088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125241088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125241088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:42.513495 run osmo-stp_10.42.42.5(pid=23310): stdout: | (launched: 2022-12-13_12:52:40.913347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:42.638019 run osmo-stp_10.42.42.5(pid=23310): stderr: | 20221213125241087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125241087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125241087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125241087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125241088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125241088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125241088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:42.787162 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23310): Process ended prematurely: osmo-stp_10.42.42.5(pid=23310) [trial-2389↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23310)] [trial-2389↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 12:52:42.795936 tst handover.py:18: Test FAILED (6.6 sec) 12:52:42.822424 run osmo-hlr_10.42.42.2(pid=23307): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23307)] 12:52:42.871101 run osmo-hlr_10.42.42.2(pid=23307): stdout: | (launched: 2022-12-13_12:52:39.954888) 12:52:42.921606 run osmo-hlr_10.42.42.2(pid=23307): stderr: | 20221213125240139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125240139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125240139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125240139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125240139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125240139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125240150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125240159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125240159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125240159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:42.991205 run osmo-msc_10.42.42.6(pid=23313): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23313)] 12:52:43.038850 run osmo-msc_10.42.42.6(pid=23313): stdout: | (launched: 2022-12-13_12:52:41.883316) 12:52:43.088508 run osmo-msc_10.42.42.6(pid=23313): stderr: | 20221213125242157 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125242158 DLGLOBAL DEBUG validating counter group 0x7f1c544d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125242158 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125242158 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125242158 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125242158 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125242160 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125242160 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125242160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125242160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:52:43.138457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23306): Terminating (SIGTERM) 12:52:43.178556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23309): Terminating (SIGTERM) 12:52:43.218478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23312): Terminating (SIGTERM) 12:52:43.258499 --- ParallelTerminationStrategy: PID 23306 died... 12:52:43.278279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23306): Terminated: ok {rc=0} 12:52:43.322986 --- ParallelTerminationStrategy: PID 23309 died... 12:52:43.342183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23309): Terminated: ok {rc=0} 12:52:43.386594 --- ParallelTerminationStrategy: PID 23312 died... 12:52:43.405805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23312): Terminated: ok {rc=0} 12:52:43.492545 bus /sierra_3: Setting Powered False 12:52:44.590323 bus /sierra_3: Setting Powered False 12:52:45.703154 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 12:52:46.967283 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:46.973356 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:52:47.028763 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:52:47.056820 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:52:47.112414 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:52:47.173387 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:52:47.209956 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:52:47.743838 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 12:52:47.749696 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:52:47.761297 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:52:47.796264 tst handover.py: using LAC 34071 12:52:47.924353 tst handover.py: using RAC 156 12:52:48.046156 tst handover.py: using CellId 34071 12:52:48.168036 tst handover.py: using BVCI 34072 12:52:48.291556 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:52:48.340201 tst handover.py: using LAC 34072 12:52:48.471089 tst handover.py: using RAC 157 12:52:48.602549 tst handover.py: using CellId 34072 12:52:48.731842 tst handover.py: using BVCI 34073 12:52:48.854525 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:52:48.866359 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:52:48.877687 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:52:48.889089 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:52:48.900455 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:52:48.911696 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:52:49.035068 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:52:49.153775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:49.609731 run create_hlr_db(pid=23318): Launched 12:52:49.730374 bus /sierra_2: Setting Powered False 12:52:50.792870 run create_hlr_db(pid=23318): Terminated: ok {rc=0} 12:52:51.219547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23320): Launched 12:52:51.554757 run osmo-hlr_10.42.42.2(pid=23321): Launched 12:52:51.684889 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:52.252524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23323): Launched 12:52:52.586196 run osmo-stp_10.42.42.5(pid=23324): Launched 12:52:52.713951 run osmo-msc_10.42.42.6: Starting osmo-msc 12:52:53.284835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23326): Launched 12:52:53.618663 run osmo-msc_10.42.42.6(pid=23327): Launched 12:52:53.804484 run osmo-stp_10.42.42.5(pid=23324): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23324)] 12:52:53.953888 run osmo-stp_10.42.42.5(pid=23324): stdout: | (launched: 2022-12-13_12:52:52.524572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:54.094036 run osmo-stp_10.42.42.5(pid=23324): stderr: | 20221213125252719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125252719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125252719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125252720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125252720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125252720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125252720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:54.232752 run osmo-stp_10.42.42.5(pid=23324): stdout: | (launched: 2022-12-13_12:52:52.524572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:54.364520 run osmo-stp_10.42.42.5(pid=23324): stderr: | 20221213125252719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125252719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125252719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125252720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125252720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125252720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125252720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:54.522119 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23324): Process ended prematurely: osmo-stp_10.42.42.5(pid=23324) [trial-2389↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23324)] [trial-2389↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 12:52:54.531277 tst handover.py:18: Test FAILED (6.8 sec) 12:52:54.558775 run osmo-hlr_10.42.42.2(pid=23321): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23321)] 12:52:54.608887 run osmo-hlr_10.42.42.2(pid=23321): stdout: | (launched: 2022-12-13_12:52:51.493353) 12:52:54.661147 run osmo-hlr_10.42.42.2(pid=23321): stderr: | 20221213125251694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125251694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125251694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125251694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125251694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125251694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125251707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125251716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125251716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125251716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:54.733374 run osmo-msc_10.42.42.6(pid=23327): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23327)] 12:52:54.783252 run osmo-msc_10.42.42.6(pid=23327): stdout: | (launched: 2022-12-13_12:52:53.557047) 12:52:54.835020 run osmo-msc_10.42.42.6(pid=23327): stderr: | 20221213125253882 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125253882 DLGLOBAL DEBUG validating counter group 0x7f41d6c0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125253882 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125253882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125253883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125253883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125253891 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125253892 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125253892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125253892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:52:54.887603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23320): Terminating (SIGTERM) 12:52:54.929364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23323): Terminating (SIGTERM) 12:52:54.970892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23326): Terminating (SIGTERM) 12:52:55.013215 --- ParallelTerminationStrategy: PID 23320 died... 12:52:55.033245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23320): Terminated: ok {rc=0} 12:52:55.079382 --- ParallelTerminationStrategy: PID 23323 died... 12:52:55.099081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23323): Terminated: ok {rc=0} 12:52:55.144922 --- ParallelTerminationStrategy: PID 23326 died... 12:52:55.164527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23326): Terminated: ok {rc=0} 12:52:55.252675 bus /sierra_3: Setting Powered False 12:52:56.351062 bus /sierra_3: Setting Powered False 12:52:57.466557 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:52:58.726327 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:58.732026 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:52:58.780132 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:52:58.808001 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:52:58.863476 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:52:58.910621 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:52:58.936880 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:52:59.490454 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:52:59.495939 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:52:59.507046 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:52:59.540725 tst handover.py: using LAC 34073 12:52:59.667562 tst handover.py: using RAC 158 12:52:59.797791 tst handover.py: using CellId 34073 12:52:59.928219 tst handover.py: using BVCI 34074 12:53:00.044727 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:53:00.090291 tst handover.py: using LAC 34074 12:53:00.213657 tst handover.py: using RAC 159 12:53:00.347698 tst handover.py: using CellId 34074 12:53:00.481822 tst handover.py: using BVCI 34075 12:53:00.597606 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:53:00.608700 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:53:00.619852 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:53:00.631019 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:53:00.642703 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:53:00.654128 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:53:00.777435 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:53:00.907148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:01.389179 run create_hlr_db(pid=23333): Launched 12:53:01.545296 bus /sierra_2: Setting Powered False 12:53:02.611023 run create_hlr_db(pid=23333): Terminated: ok {rc=0} 12:53:03.044607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23335): Launched 12:53:03.379757 run osmo-hlr_10.42.42.2(pid=23336): Launched 12:53:03.508354 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:04.052566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23338): Launched 12:53:04.388270 run osmo-stp_10.42.42.5(pid=23339): Launched 12:53:04.516723 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:05.089924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23341): Launched 12:53:05.424936 run osmo-msc_10.42.42.6(pid=23342): Launched 12:53:05.611812 run osmo-stp_10.42.42.5(pid=23339): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23339)] 12:53:05.754244 run osmo-stp_10.42.42.5(pid=23339): stdout: | (launched: 2022-12-13_12:53:04.326400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:05.894927 run osmo-stp_10.42.42.5(pid=23339): stderr: | 20221213125304523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125304523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125304523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125304524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125304524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125304524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125304524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:06.033521 run osmo-stp_10.42.42.5(pid=23339): stdout: | (launched: 2022-12-13_12:53:04.326400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:06.166476 run osmo-stp_10.42.42.5(pid=23339): stderr: | 20221213125304523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125304523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125304523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125304524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125304524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125304524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125304524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:06.324423 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23339): Process ended prematurely: osmo-stp_10.42.42.5(pid=23339) [trial-2389↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23339)] [trial-2389↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 12:53:06.333604 tst handover.py:18: Test FAILED (6.8 sec) 12:53:06.361418 run osmo-hlr_10.42.42.2(pid=23336): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23336)] 12:53:06.411680 run osmo-hlr_10.42.42.2(pid=23336): stdout: | (launched: 2022-12-13_12:53:03.318071) 12:53:06.463879 run osmo-hlr_10.42.42.2(pid=23336): stderr: | 20221213125303518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125303518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125303518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125303518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125303518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125303518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125303530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125303541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125303541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125303541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:06.536561 run osmo-msc_10.42.42.6(pid=23342): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23342)] 12:53:06.586672 run osmo-msc_10.42.42.6(pid=23342): stdout: | (launched: 2022-12-13_12:53:05.363240) 12:53:06.638575 run osmo-msc_10.42.42.6(pid=23342): stderr: | 20221213125305691 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125305691 DLGLOBAL DEBUG validating counter group 0x7f8632cf8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125305691 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125305691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125305691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125305691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125305693 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125305693 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125305694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125305694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:06.691157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23335): Terminating (SIGTERM) 12:53:06.732823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23338): Terminating (SIGTERM) 12:53:06.775144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23341): Terminating (SIGTERM) 12:53:06.817527 --- ParallelTerminationStrategy: PID 23335 died... 12:53:06.837567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23335): Terminated: ok {rc=0} 12:53:06.884107 --- ParallelTerminationStrategy: PID 23338 died... 12:53:06.903669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23338): Terminated: ok {rc=0} 12:53:06.949884 --- ParallelTerminationStrategy: PID 23341 died... 12:53:06.969460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23341): Terminated: ok {rc=0} 12:53:07.057889 bus /sierra_3: Setting Powered False 12:53:08.156597 bus /sierra_3: Setting Powered False 12:53:09.271685 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:53:10.532229 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:53:10.537357 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:53:10.589635 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:53:10.616192 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:53:10.666611 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:53:10.718193 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:53:10.744608 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:53:11.299461 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:53:11.304608 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:53:11.315720 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:53:11.349884 tst handover.py: using LAC 34075 12:53:11.473315 tst handover.py: using RAC 160 12:53:11.593834 tst handover.py: using CellId 34075 12:53:11.717165 tst handover.py: using BVCI 34076 12:53:11.831279 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:53:11.878807 tst handover.py: using LAC 34076 12:53:11.999077 tst handover.py: using RAC 161 12:53:12.119816 tst handover.py: using CellId 34076 12:53:12.241370 tst handover.py: using BVCI 34077 12:53:12.354183 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:53:12.365452 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:53:12.376249 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:53:12.387063 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:53:12.398557 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:53:12.409808 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:53:12.528628 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:53:12.646295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:13.103321 run create_hlr_db(pid=23348): Launched 12:53:13.223831 bus /sierra_2: Setting Powered False 12:53:14.286481 run create_hlr_db(pid=23348): Terminated: ok {rc=0} 12:53:14.694979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23350): Launched 12:53:15.008884 run osmo-hlr_10.42.42.2(pid=23351): Launched 12:53:15.127844 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:15.653119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23353): Launched 12:53:16.013415 run osmo-stp_10.42.42.5(pid=23354): Launched 12:53:16.186252 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:16.877747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23356): Launched 12:53:17.202777 run osmo-msc_10.42.42.6(pid=23357): Launched 12:53:17.397499 run osmo-stp_10.42.42.5(pid=23354): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23354)] 12:53:17.530886 run osmo-stp_10.42.42.5(pid=23354): stdout: | (launched: 2022-12-13_12:53:15.953744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:17.665452 run osmo-stp_10.42.42.5(pid=23354): stderr: | 20221213125316358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125316358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125316358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125316358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125316359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125316359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125316359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:17.794928 run osmo-stp_10.42.42.5(pid=23354): stdout: | (launched: 2022-12-13_12:53:15.953744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:17.918659 run osmo-stp_10.42.42.5(pid=23354): stderr: | 20221213125316358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125316358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125316358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125316358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125316359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125316359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125316359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:18.066683 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23354): Process ended prematurely: osmo-stp_10.42.42.5(pid=23354) [trial-2389↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23354)] [trial-2389↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 12:53:18.075090 tst handover.py:18: Test FAILED (6.8 sec) 12:53:18.101646 run osmo-hlr_10.42.42.2(pid=23351): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23351)] 12:53:18.150642 run osmo-hlr_10.42.42.2(pid=23351): stdout: | (launched: 2022-12-13_12:53:14.951211) 12:53:18.201268 run osmo-hlr_10.42.42.2(pid=23351): stderr: | 20221213125315132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125315132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125315132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125315132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125315132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125315132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125315144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125315153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125315153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125315154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:18.271670 run osmo-msc_10.42.42.6(pid=23357): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23357)] 12:53:18.320105 run osmo-msc_10.42.42.6(pid=23357): stdout: | (launched: 2022-12-13_12:53:17.143628) 12:53:18.370387 run osmo-msc_10.42.42.6(pid=23357): stderr: | 20221213125317527 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125317527 DLGLOBAL DEBUG validating counter group 0x7f0d22d95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125317528 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125317528 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125317528 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125317528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125317530 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125317530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125317530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125317530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:18.421093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23350): Terminating (SIGTERM) 12:53:18.461747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23353): Terminating (SIGTERM) 12:53:18.502088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23356): Terminating (SIGTERM) 12:53:18.543395 --- ParallelTerminationStrategy: PID 23350 died... 12:53:18.563105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23350): Terminated: ok {rc=0} 12:53:18.608173 --- ParallelTerminationStrategy: PID 23353 died... 12:53:18.627475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23353): Terminated: ok {rc=0} 12:53:18.673179 --- ParallelTerminationStrategy: PID 23356 died... 12:53:18.692450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23356): Terminated: ok {rc=0} 12:53:18.780833 bus /sierra_3: Setting Powered False 12:53:19.883090 bus /sierra_3: Setting Powered False 12:53:21.000408 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 12:53:22.270246 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:53:22.275609 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:53:22.315607 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:53:22.343418 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:53:22.397907 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:53:22.437171 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:53:22.464575 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:53:23.017375 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 12:53:23.023064 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:53:23.034609 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 12:53:23.069479 tst handover.py: using LAC 34077 12:53:23.193359 tst handover.py: using RAC 162 12:53:23.317060 tst handover.py: using CellId 34077 12:53:23.441653 tst handover.py: using BVCI 34078 12:53:23.563860 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 12:53:23.601274 tst handover.py: using LAC 34078 12:53:23.733178 tst handover.py: using RAC 163 12:53:23.864194 tst handover.py: using CellId 34078 12:53:23.995659 tst handover.py: using BVCI 34079 12:53:24.118513 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:53:24.130053 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:53:24.141284 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:53:24.152513 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:53:24.164288 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:53:24.176025 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 12:53:24.301385 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 12:53:24.423642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:24.911079 run create_hlr_db(pid=23362): Launched 12:53:25.045426 bus /sierra_2: Setting Powered False 12:53:26.110877 run create_hlr_db(pid=23362): Terminated: ok {rc=0} 12:53:26.545900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23364): Launched 12:53:26.879416 run osmo-hlr_10.42.42.2(pid=23366): Launched 12:53:27.008562 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:27.557303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23368): Launched 12:53:27.892459 run osmo-stp_10.42.42.5(pid=23369): Launched 12:53:28.021706 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:28.595086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23371): Launched 12:53:28.929659 run osmo-msc_10.42.42.6(pid=23372): Launched 12:53:29.115684 run osmo-stp_10.42.42.5(pid=23369): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23369)] 12:53:29.255159 run osmo-stp_10.42.42.5(pid=23369): stdout: | (launched: 2022-12-13_12:53:27.830491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:29.395374 run osmo-stp_10.42.42.5(pid=23369): stderr: | 20221213125328024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125328024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125328024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125328024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125328025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125328025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125328025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:29.534548 run osmo-stp_10.42.42.5(pid=23369): stdout: | (launched: 2022-12-13_12:53:27.830491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:29.666810 run osmo-stp_10.42.42.5(pid=23369): stderr: | 20221213125328024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125328024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125328024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125328024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125328025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125328025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125328025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:29.825042 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23369): Process ended prematurely: osmo-stp_10.42.42.5(pid=23369) [trial-2389↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23369)] [trial-2389↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 12:53:29.834145 tst handover.py:18: Test FAILED (6.8 sec) 12:53:29.862187 run osmo-hlr_10.42.42.2(pid=23366): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23366)] 12:53:29.912857 run osmo-hlr_10.42.42.2(pid=23366): stdout: | (launched: 2022-12-13_12:53:26.817485) 12:53:29.965224 run osmo-hlr_10.42.42.2(pid=23366): stderr: | 20221213125327018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125327018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125327018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125327018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125327018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125327018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125327030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125327040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125327040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125327040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:30.038181 run osmo-msc_10.42.42.6(pid=23372): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23372)] 12:53:30.088403 run osmo-msc_10.42.42.6(pid=23372): stdout: | (launched: 2022-12-13_12:53:28.867653) 12:53:30.140550 run osmo-msc_10.42.42.6(pid=23372): stderr: | 20221213125329194 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125329194 DLGLOBAL DEBUG validating counter group 0x7f55207ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125329194 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125329194 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125329194 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125329194 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125329196 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125329196 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125329197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125329197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:30.193056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23364): Terminating (SIGTERM) 12:53:30.235015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23368): Terminating (SIGTERM) 12:53:30.277646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23371): Terminating (SIGTERM) 12:53:30.319824 --- ParallelTerminationStrategy: PID 23364 died... 12:53:30.339873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23364): Terminated: ok {rc=0} 12:53:30.386781 --- ParallelTerminationStrategy: PID 23368 died... 12:53:30.406442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23368): Terminated: ok {rc=0} 12:53:30.452616 --- ParallelTerminationStrategy: PID 23371 died... 12:53:30.472363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23371): Terminated: ok {rc=0} 12:53:30.560612 bus /sierra_3: Setting Powered False 12:53:31.673216 bus /sierra_3: Setting Powered False 12:53:32.795456 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 12:53:34.041696 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:53:34.047213 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:53:34.099258 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:53:34.126878 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:53:34.181919 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:53:34.233683 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:53:34.260635 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:53:34.811419 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 12:53:34.817165 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:53:34.828335 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:53:34.868835 tst handover.py: using LAC 34079 12:53:34.999150 tst handover.py: using RAC 164 12:53:35.126651 tst handover.py: using CellId 34079 12:53:35.254207 tst handover.py: using BVCI 34080 12:53:35.375800 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:53:35.424374 tst handover.py: using LAC 34080 12:53:35.551942 tst handover.py: using RAC 165 12:53:35.680173 tst handover.py: using CellId 34080 12:53:35.807408 tst handover.py: using BVCI 34081 12:53:35.927684 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:53:35.939056 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:53:35.950320 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:53:35.961616 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:53:35.972816 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:53:35.983972 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:53:36.101967 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:53:36.221825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:36.707683 run create_hlr_db(pid=23377): Launched 12:53:36.842825 bus /sierra_2: Setting Powered False 12:53:37.907943 run create_hlr_db(pid=23377): Terminated: ok {rc=0} 12:53:38.325441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23379): Launched 12:53:38.639111 run osmo-hlr_10.42.42.2(pid=23380): Launched 12:53:38.760338 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:39.270279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23382): Launched 12:53:39.582771 run osmo-stp_10.42.42.5(pid=23383): Launched 12:53:39.704574 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:40.250870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23385): Launched 12:53:40.565127 run osmo-msc_10.42.42.6(pid=23386): Launched 12:53:40.742909 run osmo-stp_10.42.42.5(pid=23383): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23383)] 12:53:40.875619 run osmo-stp_10.42.42.5(pid=23383): stdout: | (launched: 2022-12-13_12:53:39.524577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:41.006898 run osmo-stp_10.42.42.5(pid=23383): stderr: | 20221213125339699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125339699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125339699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125339700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125339700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125339700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125339700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:41.135882 run osmo-stp_10.42.42.5(pid=23383): stdout: | (launched: 2022-12-13_12:53:39.524577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:41.259332 run osmo-stp_10.42.42.5(pid=23383): stderr: | 20221213125339699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125339699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125339699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125339700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125339700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125339700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125339700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:41.406731 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23383): Process ended prematurely: osmo-stp_10.42.42.5(pid=23383) [trial-2389↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23383)] [trial-2389↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 12:53:41.415319 tst handover.py:18: Test FAILED (6.6 sec) 12:53:41.441457 run osmo-hlr_10.42.42.2(pid=23380): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23380)] 12:53:41.490422 run osmo-hlr_10.42.42.2(pid=23380): stdout: | (launched: 2022-12-13_12:53:38.580740) 12:53:41.540415 run osmo-hlr_10.42.42.2(pid=23380): stderr: | 20221213125338758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125338758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125338758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125338758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125338758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125338758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125338770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125338778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125338778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125338778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:41.610104 run osmo-msc_10.42.42.6(pid=23386): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23386)] 12:53:41.657718 run osmo-msc_10.42.42.6(pid=23386): stdout: | (launched: 2022-12-13_12:53:40.506932) 12:53:41.707501 run osmo-msc_10.42.42.6(pid=23386): stderr: | 20221213125340780 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125340780 DLGLOBAL DEBUG validating counter group 0x7f98c6a69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125340780 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125340780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125340780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125340780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125340784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125340784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125340784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125340784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:41.757548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23379): Terminating (SIGTERM) 12:53:41.797681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23382): Terminating (SIGTERM) 12:53:41.837514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23385): Terminating (SIGTERM) 12:53:41.877652 --- ParallelTerminationStrategy: PID 23379 died... 12:53:41.896850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23379): Terminated: ok {rc=0} 12:53:41.941178 --- ParallelTerminationStrategy: PID 23382 died... 12:53:41.960025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23382): Terminated: ok {rc=0} 12:53:42.004091 --- ParallelTerminationStrategy: PID 23385 died... 12:53:42.023001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23385): Terminated: ok {rc=0} 12:53:42.109290 bus /sierra_3: Setting Powered False 12:53:43.211471 bus /sierra_3: Setting Powered False 12:53:44.330760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 12:53:45.594445 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:53:45.600163 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:53:45.652318 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:53:45.680060 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:53:45.735392 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:53:45.785160 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:53:45.811603 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:53:46.370925 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 12:53:46.379424 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:53:46.395391 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:53:46.441812 tst handover.py: using LAC 34081 12:53:46.611243 tst handover.py: using RAC 166 12:53:46.759511 tst handover.py: using CellId 34081 12:53:46.904915 tst handover.py: using BVCI 34082 12:53:47.057588 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:53:47.112525 tst handover.py: using LAC 34082 12:53:47.265252 tst handover.py: using RAC 167 12:53:47.419647 tst handover.py: using CellId 34082 12:53:47.559091 tst handover.py: using BVCI 34083 12:53:47.690737 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:53:47.705417 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:53:47.720747 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:53:47.734783 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:53:47.746848 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:53:47.760029 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:53:47.911587 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:53:48.067049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:48.662010 run create_hlr_db(pid=23523): Launched 12:53:48.858884 bus /sierra_2: Setting Powered False 12:53:49.922714 run create_hlr_db(pid=23523): Terminated: ok {rc=0} 12:53:50.347227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23662): Launched 12:53:50.684030 run osmo-hlr_10.42.42.2(pid=23663): Launched 12:53:50.936934 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:51.589761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23667): Launched 12:53:51.918088 run osmo-stp_10.42.42.5(pid=23668): Launched 12:53:52.170741 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:52.874176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23670): Launched 12:53:53.205787 run osmo-msc_10.42.42.6(pid=23671): Launched 12:53:53.562381 run osmo-stp_10.42.42.5(pid=23668): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23668)] 12:53:53.881231 run osmo-stp_10.42.42.5(pid=23668): stdout: | (launched: 2022-12-13_12:53:51.859066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:54.167520 run osmo-stp_10.42.42.5(pid=23668): stderr: | 20221213125352193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125352194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125352194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125352194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125352195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125352195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125352195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:54.303141 run osmo-stp_10.42.42.5(pid=23668): stdout: | (launched: 2022-12-13_12:53:51.859066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:54.432409 run osmo-stp_10.42.42.5(pid=23668): stderr: | 20221213125352193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125352194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125352194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125352194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125352195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125352195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125352195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:54.587471 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23668): Process ended prematurely: osmo-stp_10.42.42.5(pid=23668) [trial-2389↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23668)] [trial-2389↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 12:53:54.597330 tst handover.py:18: Test FAILED (8.2 sec) 12:53:54.625505 run osmo-hlr_10.42.42.2(pid=23663): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23663)] 12:53:54.679559 run osmo-hlr_10.42.42.2(pid=23663): stdout: | (launched: 2022-12-13_12:53:50.623353) 12:53:54.733180 run osmo-hlr_10.42.42.2(pid=23663): stderr: | 20221213125350929 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125350929 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125350930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125350930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125350930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125350930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125350943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125350959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125350960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125350960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:54.806025 run osmo-msc_10.42.42.6(pid=23671): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23671)] 12:53:54.857990 run osmo-msc_10.42.42.6(pid=23671): stdout: | (launched: 2022-12-13_12:53:53.146882) 12:53:54.910504 run osmo-msc_10.42.42.6(pid=23671): stderr: | 20221213125353762 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125353763 DLGLOBAL DEBUG validating counter group 0x7f45560f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125353763 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125353763 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125353763 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125353763 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125353770 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125353771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125353771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125353771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:54.963487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23662): Terminating (SIGTERM) 12:53:55.005798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23667): Terminating (SIGTERM) 12:53:55.052137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23670): Terminating (SIGTERM) 12:53:55.097607 --- ParallelTerminationStrategy: PID 23662 died... 12:53:55.119569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23662): Terminated: ok {rc=0} 12:53:55.168240 --- ParallelTerminationStrategy: PID 23667 died... 12:53:55.189342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23667): Terminated: ok {rc=0} 12:53:55.237213 --- ParallelTerminationStrategy: PID 23670 died... 12:53:55.259059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23670): Terminated: ok {rc=0} 12:53:55.349686 bus /sierra_3: Setting Powered False 12:53:56.449708 bus /sierra_3: Setting Powered False 12:53:57.566845 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 12:53:58.827328 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:53:58.833418 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:53:58.888723 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:53:58.917277 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:53:58.972332 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:53:59.023774 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:53:59.052738 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:53:59.601647 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 12:53:59.608608 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:53:59.620620 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:53:59.659800 tst handover.py: using LAC 34083 12:53:59.788010 tst handover.py: using RAC 168 12:53:59.918184 tst handover.py: using CellId 34083 12:54:00.043717 tst handover.py: using BVCI 34084 12:54:00.163217 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:54:00.215877 tst handover.py: using LAC 34084 12:54:00.344851 tst handover.py: using RAC 169 12:54:00.472701 tst handover.py: using CellId 34084 12:54:00.597753 tst handover.py: using BVCI 34085 12:54:00.716830 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:54:00.729360 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:54:00.741286 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:54:00.753551 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:54:00.766683 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:54:00.780338 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:54:00.934870 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:54:01.098890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:01.604178 run create_hlr_db(pid=23676): Launched 12:54:01.781731 bus /sierra_2: Setting Powered False 12:54:02.849088 run create_hlr_db(pid=23676): Terminated: ok {rc=0} 12:54:03.295123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23678): Launched 12:54:03.646681 run osmo-hlr_10.42.42.2(pid=23679): Launched 12:54:03.898968 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:04.561323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23681): Launched 12:54:04.912728 run osmo-stp_10.42.42.5(pid=23682): Launched 12:54:05.164175 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:05.829763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23684): Launched 12:54:06.182379 run osmo-msc_10.42.42.6(pid=23685): Launched 12:54:06.554640 run osmo-stp_10.42.42.5(pid=23682): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23682)] 12:54:06.842090 run osmo-stp_10.42.42.5(pid=23682): stdout: | (launched: 2022-12-13_12:54:04.849844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:07.016509 run osmo-stp_10.42.42.5(pid=23682): stderr: | 20221213125405153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125405153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125405153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125405154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125405154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125405154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125405154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:07.158974 run osmo-stp_10.42.42.5(pid=23682): stdout: | (launched: 2022-12-13_12:54:04.849844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:07.295079 run osmo-stp_10.42.42.5(pid=23682): stderr: | 20221213125405153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125405153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125405153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125405154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125405154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125405154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125405154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:07.457879 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23682): Process ended prematurely: osmo-stp_10.42.42.5(pid=23682) [trial-2389↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23682)] [trial-2389↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 12:54:07.468072 tst handover.py:18: Test FAILED (7.9 sec) 12:54:07.497562 run osmo-hlr_10.42.42.2(pid=23679): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23679)] 12:54:07.549647 run osmo-hlr_10.42.42.2(pid=23679): stdout: | (launched: 2022-12-13_12:54:03.584406) 12:54:07.603275 run osmo-hlr_10.42.42.2(pid=23679): stderr: | 20221213125403902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125403902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125403902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125403902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125403902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125403902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125403914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125403926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125403927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125403927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:07.678626 run osmo-msc_10.42.42.6(pid=23685): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23685)] 12:54:07.730863 run osmo-msc_10.42.42.6(pid=23685): stdout: | (launched: 2022-12-13_12:54:06.119852) 12:54:07.784766 run osmo-msc_10.42.42.6(pid=23685): stderr: | 20221213125406629 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125406629 DLGLOBAL DEBUG validating counter group 0x7f79998b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125406629 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125406629 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125406630 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125406630 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125406631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125406632 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125406632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125406632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:07.839090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23678): Terminating (SIGTERM) 12:54:07.883855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23681): Terminating (SIGTERM) 12:54:07.930533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23684): Terminating (SIGTERM) 12:54:07.976910 --- ParallelTerminationStrategy: PID 23678 died... 12:54:07.998496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23678): Terminated: ok {rc=0} 12:54:08.048235 --- ParallelTerminationStrategy: PID 23681 died... 12:54:08.069497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23681): Terminated: ok {rc=0} 12:54:08.117383 --- ParallelTerminationStrategy: PID 23684 died... 12:54:08.138414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23684): Terminated: ok {rc=0} 12:54:08.230949 bus /sierra_3: Setting Powered False 12:54:09.335418 bus /sierra_3: Setting Powered False 12:54:10.453541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:54:11.710592 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:54:11.715762 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:54:11.761713 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:54:11.788418 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:54:11.840759 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:54:11.886406 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:54:11.913032 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:54:12.470056 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:54:12.476054 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:54:12.487919 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:54:12.526006 tst handover.py: using LAC 34085 12:54:12.657102 tst handover.py: using RAC 170 12:54:12.788701 tst handover.py: using CellId 34085 12:54:12.917280 tst handover.py: using BVCI 34086 12:54:13.039841 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:54:13.084463 tst handover.py: using LAC 34086 12:54:13.219195 tst handover.py: using RAC 171 12:54:13.350104 tst handover.py: using CellId 34086 12:54:13.478416 tst handover.py: using BVCI 34087 12:54:13.599094 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:54:13.611073 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:54:13.622771 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:54:13.634587 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:54:13.646551 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:54:13.658587 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:54:13.776220 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:54:13.897888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:14.385259 run create_hlr_db(pid=23691): Launched 12:54:14.522177 bus /sierra_2: Setting Powered False 12:54:15.588168 run create_hlr_db(pid=23691): Terminated: ok {rc=0} 12:54:16.029033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23693): Launched 12:54:16.392094 run osmo-hlr_10.42.42.2(pid=23694): Launched 12:54:16.566247 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:17.254583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23696): Launched 12:54:17.600009 run osmo-stp_10.42.42.5(pid=23697): Launched 12:54:17.728570 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:18.300465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23699): Launched 12:54:18.634826 run osmo-msc_10.42.42.6(pid=23700): Launched 12:54:18.822034 run osmo-stp_10.42.42.5(pid=23697): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23697)] 12:54:18.961499 run osmo-stp_10.42.42.5(pid=23697): stdout: | (launched: 2022-12-13_12:54:17.538484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:19.101426 run osmo-stp_10.42.42.5(pid=23697): stderr: | 20221213125417735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125417735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125417735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125417736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125417736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125417736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125417736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:19.239919 run osmo-stp_10.42.42.5(pid=23697): stdout: | (launched: 2022-12-13_12:54:17.538484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:19.371858 run osmo-stp_10.42.42.5(pid=23697): stderr: | 20221213125417735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125417735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125417735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125417736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125417736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125417736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125417736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:19.529581 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23697): Process ended prematurely: osmo-stp_10.42.42.5(pid=23697) [trial-2389↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23697)] [trial-2389↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 12:54:19.538660 tst handover.py:18: Test FAILED (7.1 sec) 12:54:19.566483 run osmo-hlr_10.42.42.2(pid=23694): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23694)] 12:54:19.616521 run osmo-hlr_10.42.42.2(pid=23694): stdout: | (launched: 2022-12-13_12:54:16.330205) 12:54:19.668452 run osmo-hlr_10.42.42.2(pid=23694): stderr: | 20221213125416685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125416685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125416685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125416685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125416685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125416685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125416703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125416719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125416720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125416720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:19.740843 run osmo-msc_10.42.42.6(pid=23700): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23700)] 12:54:19.790877 run osmo-msc_10.42.42.6(pid=23700): stdout: | (launched: 2022-12-13_12:54:18.572377) 12:54:19.842755 run osmo-msc_10.42.42.6(pid=23700): stderr: | 20221213125418901 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125418901 DLGLOBAL DEBUG validating counter group 0x7fd45e6d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125418902 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125418902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125418902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125418902 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125418904 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125418904 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125418904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125418904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:19.895763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23693): Terminating (SIGTERM) 12:54:19.937831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23696): Terminating (SIGTERM) 12:54:19.980205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23699): Terminating (SIGTERM) 12:54:20.022521 --- ParallelTerminationStrategy: PID 23693 died... 12:54:20.042815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23693): Terminated: ok {rc=0} 12:54:20.089235 --- ParallelTerminationStrategy: PID 23696 died... 12:54:20.108846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23696): Terminated: ok {rc=0} 12:54:20.154884 --- ParallelTerminationStrategy: PID 23699 died... 12:54:20.174562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23699): Terminated: ok {rc=0} 12:54:20.262083 bus /sierra_3: Setting Powered False 12:54:21.362033 bus /sierra_3: Setting Powered False 12:54:22.478557 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:54:23.738698 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:54:23.744357 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:54:23.795009 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:54:23.821573 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:54:23.873330 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:54:23.923754 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:54:23.951004 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:54:24.502550 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:54:24.508004 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:54:24.519118 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:54:24.552716 tst handover.py: using LAC 34087 12:54:24.675114 tst handover.py: using RAC 172 12:54:24.798853 tst handover.py: using CellId 34087 12:54:24.922390 tst handover.py: using BVCI 34088 12:54:25.036739 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:54:25.086408 tst handover.py: using LAC 34088 12:54:25.220063 tst handover.py: using RAC 173 12:54:25.347378 tst handover.py: using CellId 34088 12:54:25.469384 tst handover.py: using BVCI 34089 12:54:25.581830 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:54:25.593083 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:54:25.604103 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:54:25.615248 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:54:25.626694 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:54:25.638070 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:54:25.755450 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:54:25.876242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:26.362450 run create_hlr_db(pid=23705): Launched 12:54:26.498420 bus /sierra_2: Setting Powered False 12:54:27.564455 run create_hlr_db(pid=23705): Terminated: ok {rc=0} 12:54:27.981532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23707): Launched 12:54:28.294809 run osmo-hlr_10.42.42.2(pid=23708): Launched 12:54:28.415780 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:28.940431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23710): Launched 12:54:29.255971 run osmo-stp_10.42.42.5(pid=23711): Launched 12:54:29.377429 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:29.911459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23713): Launched 12:54:30.224861 run osmo-msc_10.42.42.6(pid=23714): Launched 12:54:30.399859 run osmo-stp_10.42.42.5(pid=23711): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23711)] 12:54:30.531480 run osmo-stp_10.42.42.5(pid=23711): stdout: | (launched: 2022-12-13_12:54:29.196592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:30.663083 run osmo-stp_10.42.42.5(pid=23711): stderr: | 20221213125429368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125429369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125429369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125429369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125429371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125429372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125429372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:30.792590 run osmo-stp_10.42.42.5(pid=23711): stdout: | (launched: 2022-12-13_12:54:29.196592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:30.937364 run osmo-stp_10.42.42.5(pid=23711): stderr: | 20221213125429368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125429369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125429369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125429369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125429371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125429372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125429372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:31.089634 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23711): Process ended prematurely: osmo-stp_10.42.42.5(pid=23711) [trial-2389↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23711)] [trial-2389↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 12:54:31.099213 tst handover.py:18: Test FAILED (6.6 sec) 12:54:31.126977 run osmo-hlr_10.42.42.2(pid=23708): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23708)] 12:54:31.178935 run osmo-hlr_10.42.42.2(pid=23708): stdout: | (launched: 2022-12-13_12:54:28.236816) 12:54:31.232041 run osmo-hlr_10.42.42.2(pid=23708): stderr: | 20221213125428413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125428413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125428413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125428413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125428413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125428413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125428426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125428434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125428434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125428435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:31.304637 run osmo-msc_10.42.42.6(pid=23714): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23714)] 12:54:31.354440 run osmo-msc_10.42.42.6(pid=23714): stdout: | (launched: 2022-12-13_12:54:30.166655) 12:54:31.407594 run osmo-msc_10.42.42.6(pid=23714): stderr: | 20221213125430442 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125430442 DLGLOBAL DEBUG validating counter group 0x7f1f80e11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125430442 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125430442 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125430442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125430442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125430444 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125430445 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125430445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125430445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:31.459296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23707): Terminating (SIGTERM) 12:54:31.501662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23710): Terminating (SIGTERM) 12:54:31.543826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23713): Terminating (SIGTERM) 12:54:31.586620 --- ParallelTerminationStrategy: PID 23707 died... 12:54:31.607705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23707): Terminated: ok {rc=0} 12:54:31.654782 --- ParallelTerminationStrategy: PID 23710 died... 12:54:31.675975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23710): Terminated: ok {rc=0} 12:54:31.723109 --- ParallelTerminationStrategy: PID 23713 died... 12:54:31.744179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23713): Terminated: ok {rc=0} 12:54:31.833975 bus /sierra_3: Setting Powered False 12:54:32.930714 bus /sierra_3: Setting Powered False 12:54:34.044052 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 12:54:35.310512 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:54:35.315685 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:54:35.353139 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:54:35.379985 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:54:35.431969 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:54:35.469951 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:54:35.497441 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:54:36.050663 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 12:54:36.056684 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:54:36.068266 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 12:54:36.102737 tst handover.py: using LAC 34089 12:54:36.231799 tst handover.py: using RAC 174 12:54:36.360629 tst handover.py: using CellId 34089 12:54:36.493470 tst handover.py: using BVCI 34090 12:54:36.616444 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 12:54:36.651727 tst handover.py: using LAC 34090 12:54:36.781410 tst handover.py: using RAC 175 12:54:36.910800 tst handover.py: using CellId 34090 12:54:37.039608 tst handover.py: using BVCI 34091 12:54:37.160107 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:54:37.171681 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:54:37.183073 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:54:37.194616 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:54:37.206479 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:54:37.218148 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 12:54:37.337888 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 12:54:37.458635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:37.946605 run create_hlr_db(pid=23719): Launched 12:54:38.081444 bus /sierra_2: Setting Powered False 12:54:39.146833 run create_hlr_db(pid=23719): Terminated: ok {rc=0} 12:54:39.581030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23721): Launched 12:54:39.914680 run osmo-hlr_10.42.42.2(pid=23722): Launched 12:54:40.042343 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:40.590121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23724): Launched 12:54:40.924441 run osmo-stp_10.42.42.5(pid=23725): Launched 12:54:41.053219 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:41.625893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23727): Launched 12:54:41.961738 run osmo-msc_10.42.42.6(pid=23728): Launched 12:54:42.147030 run osmo-stp_10.42.42.5(pid=23725): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23725)] 12:54:42.286231 run osmo-stp_10.42.42.5(pid=23725): stdout: | (launched: 2022-12-13_12:54:40.862511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:42.426647 run osmo-stp_10.42.42.5(pid=23725): stderr: | 20221213125441061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125441061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125441061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125441062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125441064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125441064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125441064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:42.565686 run osmo-stp_10.42.42.5(pid=23725): stdout: | (launched: 2022-12-13_12:54:40.862511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:42.697833 run osmo-stp_10.42.42.5(pid=23725): stderr: | 20221213125441061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125441061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125441061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125441062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125441064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125441064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125441064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:42.856478 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23725): Process ended prematurely: osmo-stp_10.42.42.5(pid=23725) [trial-2389↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23725)] [trial-2389↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 12:54:42.865862 tst handover.py:18: Test FAILED (6.8 sec) 12:54:42.893967 run osmo-hlr_10.42.42.2(pid=23722): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23722)] 12:54:42.944272 run osmo-hlr_10.42.42.2(pid=23722): stdout: | (launched: 2022-12-13_12:54:39.852834) 12:54:42.996620 run osmo-hlr_10.42.42.2(pid=23722): stderr: | 20221213125440055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125440055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125440055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125440055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125440055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125440055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125440068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125440076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125440077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125440077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:43.069034 run osmo-msc_10.42.42.6(pid=23728): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23728)] 12:54:43.119074 run osmo-msc_10.42.42.6(pid=23728): stdout: | (launched: 2022-12-13_12:54:41.899854) 12:54:43.170773 run osmo-msc_10.42.42.6(pid=23728): stderr: | 20221213125442226 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125442226 DLGLOBAL DEBUG validating counter group 0x7fc61dedec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125442226 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125442226 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125442227 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125442227 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125442228 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125442229 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125442229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125442229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:43.223439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23721): Terminating (SIGTERM) 12:54:43.265425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23724): Terminating (SIGTERM) 12:54:43.307942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23727): Terminating (SIGTERM) 12:54:43.350053 --- ParallelTerminationStrategy: PID 23721 died... 12:54:43.370160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23721): Terminated: ok {rc=0} 12:54:43.416566 --- ParallelTerminationStrategy: PID 23724 died... 12:54:43.436288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23724): Terminated: ok {rc=0} 12:54:43.482550 --- ParallelTerminationStrategy: PID 23727 died... 12:54:43.502240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23727): Terminated: ok {rc=0} 12:54:43.590583 bus /sierra_3: Setting Powered False 12:54:44.688564 bus /sierra_3: Setting Powered False 12:54:45.806855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 12:54:47.063459 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:54:47.069143 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:54:47.121835 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:54:47.150235 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:54:47.204650 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:54:47.257316 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:54:47.284494 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:54:47.837347 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 12:54:47.842853 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:54:47.854525 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:54:47.889053 tst handover.py: using LAC 34091 12:54:48.019125 tst handover.py: using RAC 176 12:54:48.150233 tst handover.py: using CellId 34091 12:54:48.280284 tst handover.py: using BVCI 34092 12:54:48.402414 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:54:48.453946 tst handover.py: using LAC 34092 12:54:48.585422 tst handover.py: using RAC 177 12:54:48.716227 tst handover.py: using CellId 34092 12:54:48.847610 tst handover.py: using BVCI 34093 12:54:48.971714 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:54:48.983253 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:54:48.994652 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:54:49.006078 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:54:49.017564 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:54:49.028814 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:54:49.145629 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:54:49.264371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:49.750972 run create_hlr_db(pid=23733): Launched 12:54:49.885792 bus /sierra_2: Setting Powered False 12:54:50.951784 run create_hlr_db(pid=23733): Terminated: ok {rc=0} 12:54:51.370071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23735): Launched 12:54:51.685387 run osmo-hlr_10.42.42.2(pid=23736): Launched 12:54:51.804643 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:52.329389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23738): Launched 12:54:52.643249 run osmo-stp_10.42.42.5(pid=23739): Launched 12:54:52.763823 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:53.299019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23741): Launched 12:54:53.612312 run osmo-msc_10.42.42.6(pid=23742): Launched 12:54:53.788083 run osmo-stp_10.42.42.5(pid=23739): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23739)] 12:54:53.919602 run osmo-stp_10.42.42.5(pid=23739): stdout: | (launched: 2022-12-13_12:54:52.585154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:54.050492 run osmo-stp_10.42.42.5(pid=23739): stderr: | 20221213125452759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125452760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125452760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125452760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125452761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125452761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125452761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:54.179403 run osmo-stp_10.42.42.5(pid=23739): stdout: | (launched: 2022-12-13_12:54:52.585154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:54.302857 run osmo-stp_10.42.42.5(pid=23739): stderr: | 20221213125452759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125452760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125452760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125452760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125452761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125452761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125452761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:54.450323 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23739): Process ended prematurely: osmo-stp_10.42.42.5(pid=23739) [trial-2389↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23739)] [trial-2389↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 12:54:54.459208 tst handover.py:18: Test FAILED (6.6 sec) 12:54:54.485579 run osmo-hlr_10.42.42.2(pid=23736): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23736)] 12:54:54.534169 run osmo-hlr_10.42.42.2(pid=23736): stdout: | (launched: 2022-12-13_12:54:51.626850) 12:54:54.584053 run osmo-hlr_10.42.42.2(pid=23736): stderr: | 20221213125451807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125451807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125451807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125451807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125451808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125451808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125451820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125451831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125451831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125451831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:54.653801 run osmo-msc_10.42.42.6(pid=23742): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23742)] 12:54:54.701521 run osmo-msc_10.42.42.6(pid=23742): stdout: | (launched: 2022-12-13_12:54:53.554067) 12:54:54.751276 run osmo-msc_10.42.42.6(pid=23742): stderr: | 20221213125453830 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125453830 DLGLOBAL DEBUG validating counter group 0x7f8c4e1aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125453830 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125453830 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125453831 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125453831 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125453832 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125453833 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125453833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125453833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:54.801514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23735): Terminating (SIGTERM) 12:54:54.841791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23738): Terminating (SIGTERM) 12:54:54.882418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23741): Terminating (SIGTERM) 12:54:54.922909 --- ParallelTerminationStrategy: PID 23735 died... 12:54:54.942450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23735): Terminated: ok {rc=0} 12:54:54.986852 --- ParallelTerminationStrategy: PID 23738 died... 12:54:55.005858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23738): Terminated: ok {rc=0} 12:54:55.050117 --- ParallelTerminationStrategy: PID 23741 died... 12:54:55.069119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23741): Terminated: ok {rc=0} 12:54:55.155741 bus /sierra_3: Setting Powered False 12:54:56.255651 bus /sierra_3: Setting Powered False 12:54:57.371215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 12:54:58.630590 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:54:58.635718 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:54:58.685336 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:54:58.711694 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:54:58.762963 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:54:58.812096 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:54:58.838859 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:54:59.392921 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 12:54:59.398583 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:54:59.410080 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:54:59.447622 tst handover.py: using LAC 34093 12:54:59.576622 tst handover.py: using RAC 178 12:54:59.706948 tst handover.py: using CellId 34093 12:54:59.835942 tst handover.py: using BVCI 34094 12:54:59.956709 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:55:00.005344 tst handover.py: using LAC 34094 12:55:00.133905 tst handover.py: using RAC 179 12:55:00.262679 tst handover.py: using CellId 34094 12:55:00.390617 tst handover.py: using BVCI 34095 12:55:00.511485 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:00.522853 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:00.534177 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:00.545390 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:00.556624 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:00.567801 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:55:00.684160 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:55:00.806550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:01.322400 run create_hlr_db(pid=23750): Launched 12:55:01.488222 bus /sierra_2: Setting Powered False 12:55:02.553415 run create_hlr_db(pid=23750): Terminated: ok {rc=0} 12:55:02.974082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23752): Launched 12:55:03.288660 run osmo-hlr_10.42.42.2(pid=23753): Launched 12:55:03.408817 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:03.933086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23755): Launched 12:55:04.245530 run osmo-stp_10.42.42.5(pid=23756): Launched 12:55:04.367128 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:04.906000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23758): Launched 12:55:05.219747 run osmo-msc_10.42.42.6(pid=23759): Launched 12:55:05.396677 run osmo-stp_10.42.42.5(pid=23756): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23756)] 12:55:05.527808 run osmo-stp_10.42.42.5(pid=23756): stdout: | (launched: 2022-12-13_12:55:04.186971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:05.659335 run osmo-stp_10.42.42.5(pid=23756): stderr: | 20221213125504362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125504362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125504362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125504362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125504363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125504363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125504363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:05.788476 run osmo-stp_10.42.42.5(pid=23756): stdout: | (launched: 2022-12-13_12:55:04.186971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:05.912109 run osmo-stp_10.42.42.5(pid=23756): stderr: | 20221213125504362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125504362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125504362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125504362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125504363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125504363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125504363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:06.060292 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23756): Process ended prematurely: osmo-stp_10.42.42.5(pid=23756) [trial-2389↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23756)] [trial-2389↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 12:55:06.069061 tst handover.py:18: Test FAILED (6.7 sec) 12:55:06.095310 run osmo-hlr_10.42.42.2(pid=23753): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23753)] 12:55:06.144577 run osmo-hlr_10.42.42.2(pid=23753): stdout: | (launched: 2022-12-13_12:55:03.230774) 12:55:06.194587 run osmo-hlr_10.42.42.2(pid=23753): stderr: | 20221213125503407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125503407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125503407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125503407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125503407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125503407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125503419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125503427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125503427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125503427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:06.264624 run osmo-msc_10.42.42.6(pid=23759): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23759)] 12:55:06.312488 run osmo-msc_10.42.42.6(pid=23759): stdout: | (launched: 2022-12-13_12:55:05.161478) 12:55:06.362203 run osmo-msc_10.42.42.6(pid=23759): stderr: | 20221213125505434 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125505434 DLGLOBAL DEBUG validating counter group 0x7f2f82164c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125505435 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125505435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125505435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125505435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125505437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125505437 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125505437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125505437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:06.412110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23752): Terminating (SIGTERM) 12:55:06.452189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23755): Terminating (SIGTERM) 12:55:06.492365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23758): Terminating (SIGTERM) 12:55:06.532746 --- ParallelTerminationStrategy: PID 23752 died... 12:55:06.552250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23752): Terminated: ok {rc=0} 12:55:06.597438 --- ParallelTerminationStrategy: PID 23755 died... 12:55:06.616603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23755): Terminated: ok {rc=0} 12:55:06.661116 --- ParallelTerminationStrategy: PID 23758 died... 12:55:06.680118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23758): Terminated: ok {rc=0} 12:55:06.767591 bus /sierra_3: Setting Powered False 12:55:07.868937 bus /sierra_3: Setting Powered False 12:55:08.986762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:55:10.246232 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:10.253328 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:55:10.314186 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:55:10.341672 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:55:10.397413 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:55:10.456939 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:55:10.483479 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:55:11.033292 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:55:11.038813 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:55:11.050276 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:55:11.099219 tst handover.py: using LAC 34095 12:55:11.232679 tst handover.py: using RAC 180 12:55:11.364010 tst handover.py: using CellId 34095 12:55:11.494264 tst handover.py: using BVCI 34096 12:55:11.616723 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:55:11.662957 tst handover.py: using LAC 34096 12:55:11.786523 tst handover.py: using RAC 181 12:55:11.908679 tst handover.py: using CellId 34096 12:55:12.039590 tst handover.py: using BVCI 34097 12:55:12.154721 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:55:12.166182 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:55:12.177271 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:55:12.188367 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:55:12.200156 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:55:12.211752 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:55:12.332860 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:55:12.452095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:12.908099 run create_hlr_db(pid=23764): Launched 12:55:13.028480 bus /sierra_2: Setting Powered False 12:55:14.090733 run create_hlr_db(pid=23764): Terminated: ok {rc=0} 12:55:14.498835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23766): Launched 12:55:14.812454 run osmo-hlr_10.42.42.2(pid=23767): Launched 12:55:14.933162 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:15.445289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23769): Launched 12:55:15.758679 run osmo-stp_10.42.42.5(pid=23770): Launched 12:55:15.980738 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:16.639209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23772): Launched 12:55:16.993349 run osmo-msc_10.42.42.6(pid=23773): Launched 12:55:17.311233 run osmo-stp_10.42.42.5(pid=23770): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23770)] 12:55:17.453101 run osmo-stp_10.42.42.5(pid=23770): stdout: | (launched: 2022-12-13_12:55:15.700536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:17.593807 run osmo-stp_10.42.42.5(pid=23770): stderr: | 20221213125515883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125515883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125515884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125515884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125515885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125515885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125515885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:17.732183 run osmo-stp_10.42.42.5(pid=23770): stdout: | (launched: 2022-12-13_12:55:15.700536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:17.864446 run osmo-stp_10.42.42.5(pid=23770): stderr: | 20221213125515883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125515883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125515884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125515884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125515885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125515885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125515885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:18.023348 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23770): Process ended prematurely: osmo-stp_10.42.42.5(pid=23770) [trial-2389↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23770)] [trial-2389↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 12:55:18.032708 tst handover.py:18: Test FAILED (7.0 sec) 12:55:18.060696 run osmo-hlr_10.42.42.2(pid=23767): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23767)] 12:55:18.110895 run osmo-hlr_10.42.42.2(pid=23767): stdout: | (launched: 2022-12-13_12:55:14.754160) 12:55:18.162817 run osmo-hlr_10.42.42.2(pid=23767): stderr: | 20221213125514934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125514934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125514935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125514935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125514935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125514935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125514947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125514955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125514956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125514956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:18.235353 run osmo-msc_10.42.42.6(pid=23773): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23773)] 12:55:18.285694 run osmo-msc_10.42.42.6(pid=23773): stdout: | (launched: 2022-12-13_12:55:16.931480) 12:55:18.337868 run osmo-msc_10.42.42.6(pid=23773): stderr: | 20221213125517311 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125517311 DLGLOBAL DEBUG validating counter group 0x7f8963138c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125517311 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125517311 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125517311 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125517312 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125517313 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125517314 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125517314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125517314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:18.390291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23766): Terminating (SIGTERM) 12:55:18.432138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23769): Terminating (SIGTERM) 12:55:18.474252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23772): Terminating (SIGTERM) 12:55:18.516427 --- ParallelTerminationStrategy: PID 23766 died... 12:55:18.537072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23766): Terminated: ok {rc=0} 12:55:18.583738 --- ParallelTerminationStrategy: PID 23769 died... 12:55:18.603523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23769): Terminated: ok {rc=0} 12:55:18.649542 --- ParallelTerminationStrategy: PID 23772 died... 12:55:18.669406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23772): Terminated: ok {rc=0} 12:55:18.757903 bus /sierra_3: Setting Powered False 12:55:19.857547 bus /sierra_3: Setting Powered False 12:55:20.974152 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:55:22.242219 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:22.247463 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:55:22.311270 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:55:22.337944 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:55:22.391369 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:55:22.455555 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:55:22.482623 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:55:23.037632 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:55:23.043060 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:55:23.054786 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:55:23.103398 tst handover.py: using LAC 34097 12:55:23.233626 tst handover.py: using RAC 182 12:55:23.362733 tst handover.py: using CellId 34097 12:55:23.493668 tst handover.py: using BVCI 34098 12:55:23.615872 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:55:23.665853 tst handover.py: using LAC 34098 12:55:23.788279 tst handover.py: using RAC 183 12:55:23.911710 tst handover.py: using CellId 34098 12:55:24.038706 tst handover.py: using BVCI 34099 12:55:24.153267 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:55:24.164395 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:55:24.175576 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:55:24.186695 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:55:24.198572 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:55:24.210450 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:55:24.333041 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:55:24.455991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:24.943266 run create_hlr_db(pid=23779): Launched 12:55:25.078463 bus /sierra_2: Setting Powered False 12:55:26.144039 run create_hlr_db(pid=23779): Terminated: ok {rc=0} 12:55:26.577794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23781): Launched 12:55:26.911836 run osmo-hlr_10.42.42.2(pid=23782): Launched 12:55:27.040880 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:27.591049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23784): Launched 12:55:27.925237 run osmo-stp_10.42.42.5(pid=23785): Launched 12:55:28.053914 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:28.625679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23787): Launched 12:55:28.960889 run osmo-msc_10.42.42.6(pid=23788): Launched 12:55:29.151701 run osmo-stp_10.42.42.5(pid=23785): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23785)] 12:55:29.291948 run osmo-stp_10.42.42.5(pid=23785): stdout: | (launched: 2022-12-13_12:55:27.863309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:29.432169 run osmo-stp_10.42.42.5(pid=23785): stderr: | 20221213125528060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125528060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125528061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125528061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125528061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125528062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125528062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:29.570639 run osmo-stp_10.42.42.5(pid=23785): stdout: | (launched: 2022-12-13_12:55:27.863309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:29.702654 run osmo-stp_10.42.42.5(pid=23785): stderr: | 20221213125528060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125528060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125528061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125528061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125528061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125528062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125528062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:29.860687 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23785): Process ended prematurely: osmo-stp_10.42.42.5(pid=23785) [trial-2389↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23785)] [trial-2389↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 12:55:29.869766 tst handover.py:18: Test FAILED (6.8 sec) 12:55:29.897301 run osmo-hlr_10.42.42.2(pid=23782): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23782)] 12:55:29.947573 run osmo-hlr_10.42.42.2(pid=23782): stdout: | (launched: 2022-12-13_12:55:26.849976) 12:55:29.999656 run osmo-hlr_10.42.42.2(pid=23782): stderr: | 20221213125527053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125527053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125527053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125527053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125527053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125527053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125527065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125527074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125527074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125527074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:30.072105 run osmo-msc_10.42.42.6(pid=23788): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23788)] 12:55:30.122010 run osmo-msc_10.42.42.6(pid=23788): stdout: | (launched: 2022-12-13_12:55:28.898809) 12:55:30.173837 run osmo-msc_10.42.42.6(pid=23788): stderr: | 20221213125529226 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125529226 DLGLOBAL DEBUG validating counter group 0x7f8ee1cd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125529226 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125529226 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125529226 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125529226 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125529228 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125529228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125529228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125529229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:30.226157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23781): Terminating (SIGTERM) 12:55:30.267940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23784): Terminating (SIGTERM) 12:55:30.310429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23787): Terminating (SIGTERM) 12:55:30.352568 --- ParallelTerminationStrategy: PID 23781 died... 12:55:30.372868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23781): Terminated: ok {rc=0} 12:55:30.419485 --- ParallelTerminationStrategy: PID 23784 died... 12:55:30.439232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23784): Terminated: ok {rc=0} 12:55:30.485784 --- ParallelTerminationStrategy: PID 23787 died... 12:55:30.505473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23787): Terminated: ok {rc=0} 12:55:30.594216 bus /sierra_3: Setting Powered False 12:55:31.692480 bus /sierra_3: Setting Powered False 12:55:32.814196 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 12:55:34.087555 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:34.092791 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:55:34.144472 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:55:34.171178 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:55:34.224476 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:55:34.277258 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:55:34.304809 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:55:34.852151 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 12:55:34.858305 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:55:34.869228 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 12:55:34.917034 tst handover.py: using LAC 34099 12:55:35.038343 tst handover.py: using RAC 184 12:55:35.159576 tst handover.py: using CellId 34099 12:55:35.286351 tst handover.py: using BVCI 34100 12:55:35.407762 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 12:55:35.443155 tst handover.py: using LAC 34100 12:55:35.573956 tst handover.py: using RAC 185 12:55:35.702148 tst handover.py: using CellId 34100 12:55:35.829385 tst handover.py: using BVCI 34101 12:55:35.951963 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:55:35.963492 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:55:35.975111 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:55:35.986560 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:55:35.998182 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:55:36.009411 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 12:55:36.131394 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 12:55:36.247798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:36.703227 run create_hlr_db(pid=23793): Launched 12:55:36.824010 bus /sierra_2: Setting Powered False 12:55:37.886307 run create_hlr_db(pid=23793): Terminated: ok {rc=0} 12:55:38.312008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23795): Launched 12:55:38.646931 run osmo-hlr_10.42.42.2(pid=23796): Launched 12:55:38.776166 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:39.324045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23798): Launched 12:55:39.660384 run osmo-stp_10.42.42.5(pid=23799): Launched 12:55:39.790919 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:40.364798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23801): Launched 12:55:40.700052 run osmo-msc_10.42.42.6(pid=23802): Launched 12:55:40.886734 run osmo-stp_10.42.42.5(pid=23799): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23799)] 12:55:41.026774 run osmo-stp_10.42.42.5(pid=23799): stdout: | (launched: 2022-12-13_12:55:39.598374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:41.167370 run osmo-stp_10.42.42.5(pid=23799): stderr: | 20221213125539791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125539791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125539791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125539792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125539792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125539792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125539792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:41.306626 run osmo-stp_10.42.42.5(pid=23799): stdout: | (launched: 2022-12-13_12:55:39.598374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:41.438908 run osmo-stp_10.42.42.5(pid=23799): stderr: | 20221213125539791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125539791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125539791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125539792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125539792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125539792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125539792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:41.597138 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23799): Process ended prematurely: osmo-stp_10.42.42.5(pid=23799) [trial-2389↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23799)] [trial-2389↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 12:55:41.606245 tst handover.py:18: Test FAILED (6.7 sec) 12:55:41.633959 run osmo-hlr_10.42.42.2(pid=23796): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23796)] 12:55:41.684278 run osmo-hlr_10.42.42.2(pid=23796): stdout: | (launched: 2022-12-13_12:55:38.585373) 12:55:41.736652 run osmo-hlr_10.42.42.2(pid=23796): stderr: | 20221213125538788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125538788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125538788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125538788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125538788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125538788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125538800 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125538809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125538809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125538809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:41.809828 run osmo-msc_10.42.42.6(pid=23802): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23802)] 12:55:41.860113 run osmo-msc_10.42.42.6(pid=23802): stdout: | (launched: 2022-12-13_12:55:40.638276) 12:55:41.912217 run osmo-msc_10.42.42.6(pid=23802): stderr: | 20221213125540968 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125540968 DLGLOBAL DEBUG validating counter group 0x7f6d11731c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125540968 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125540968 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125540969 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125540969 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125540970 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125540971 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125540971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125540971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:41.964868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23795): Terminating (SIGTERM) 12:55:42.006805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23798): Terminating (SIGTERM) 12:55:42.049027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23801): Terminating (SIGTERM) 12:55:42.091510 --- ParallelTerminationStrategy: PID 23795 died... 12:55:42.111719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23795): Terminated: ok {rc=0} 12:55:42.158620 --- ParallelTerminationStrategy: PID 23798 died... 12:55:42.178419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23798): Terminated: ok {rc=0} 12:55:42.224939 --- ParallelTerminationStrategy: PID 23801 died... 12:55:42.244784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23801): Terminated: ok {rc=0} 12:55:42.333832 bus /sierra_3: Setting Powered False 12:55:43.433474 bus /sierra_3: Setting Powered False 12:55:44.551406 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 12:55:45.813247 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:45.818868 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:55:45.911900 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:55:45.940335 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:55:45.999104 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:55:46.080036 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:55:46.113262 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:55:46.635328 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 12:55:46.641591 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:55:46.654156 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:55:46.705661 tst handover.py: using LAC 34101 12:55:46.838817 tst handover.py: using RAC 186 12:55:46.990773 tst handover.py: using CellId 34101 12:55:47.155975 tst handover.py: using BVCI 34102 12:55:47.304016 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:55:47.354662 tst handover.py: using LAC 34102 12:55:47.487142 tst handover.py: using RAC 187 12:55:47.619420 tst handover.py: using CellId 34102 12:55:47.750918 tst handover.py: using BVCI 34103 12:55:47.866989 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:55:47.878308 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:55:47.889302 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:55:47.900229 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:55:47.911685 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:55:47.923011 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:55:48.043859 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:55:48.160394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:48.615442 run create_hlr_db(pid=23807): Launched 12:55:48.735754 bus /sierra_2: Setting Powered False 12:55:49.797108 run create_hlr_db(pid=23807): Terminated: ok {rc=0} 12:55:50.223834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23809): Launched 12:55:50.560535 run osmo-hlr_10.42.42.2(pid=23810): Launched 12:55:50.690918 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:51.237277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23812): Launched 12:55:51.572075 run osmo-stp_10.42.42.5(pid=23813): Launched 12:55:51.701630 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:52.282860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23815): Launched 12:55:52.617242 run osmo-msc_10.42.42.6(pid=23816): Launched 12:55:52.804295 run osmo-stp_10.42.42.5(pid=23813): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23813)] 12:55:52.944165 run osmo-stp_10.42.42.5(pid=23813): stdout: | (launched: 2022-12-13_12:55:51.510248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:53.084173 run osmo-stp_10.42.42.5(pid=23813): stderr: | 20221213125551705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125551705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125551705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125551706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125551708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125551708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125551708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:53.223649 run osmo-stp_10.42.42.5(pid=23813): stdout: | (launched: 2022-12-13_12:55:51.510248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:53.356210 run osmo-stp_10.42.42.5(pid=23813): stderr: | 20221213125551705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125551705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125551705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125551706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125551708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125551708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125551708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:53.515546 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23813): Process ended prematurely: osmo-stp_10.42.42.5(pid=23813) [trial-2389↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23813)] [trial-2389↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 12:55:53.524874 tst handover.py:18: Test FAILED (6.9 sec) 12:55:53.552603 run osmo-hlr_10.42.42.2(pid=23810): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23810)] 12:55:53.602961 run osmo-hlr_10.42.42.2(pid=23810): stdout: | (launched: 2022-12-13_12:55:50.498822) 12:55:53.655215 run osmo-hlr_10.42.42.2(pid=23810): stderr: | 20221213125550701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125550701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125550701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125550701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125550701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125550701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125550714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125550724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125550724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125550724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:53.727847 run osmo-msc_10.42.42.6(pid=23816): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23816)] 12:55:53.777820 run osmo-msc_10.42.42.6(pid=23816): stdout: | (launched: 2022-12-13_12:55:52.555435) 12:55:53.829741 run osmo-msc_10.42.42.6(pid=23816): stderr: | 20221213125552883 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125552884 DLGLOBAL DEBUG validating counter group 0x7f0eef1ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125552884 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125552884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125552884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125552884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125552886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125552886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125552886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125552886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:53.882082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23809): Terminating (SIGTERM) 12:55:53.923728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23812): Terminating (SIGTERM) 12:55:53.966141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23815): Terminating (SIGTERM) 12:55:54.008468 --- ParallelTerminationStrategy: PID 23809 died... 12:55:54.028801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23809): Terminated: ok {rc=0} 12:55:54.075430 --- ParallelTerminationStrategy: PID 23812 died... 12:55:54.095347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23812): Terminated: ok {rc=0} 12:55:54.141521 --- ParallelTerminationStrategy: PID 23815 died... 12:55:54.161509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23815): Terminated: ok {rc=0} 12:55:54.250056 bus /sierra_3: Setting Powered False 12:55:55.350025 bus /sierra_3: Setting Powered False 12:55:56.467971 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 12:55:57.740012 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:57.745266 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:55:57.807874 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:55:57.834334 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:55:57.887152 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:55:57.950492 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:55:57.977219 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:55:58.527118 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 12:55:58.532674 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:58.543842 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:55:58.593940 tst handover.py: using LAC 34103 12:55:58.726289 tst handover.py: using RAC 188 12:55:58.861576 tst handover.py: using CellId 34103 12:55:58.996251 tst handover.py: using BVCI 34104 12:55:59.118825 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:55:59.166894 tst handover.py: using LAC 34104 12:55:59.290865 tst handover.py: using RAC 189 12:55:59.413385 tst handover.py: using CellId 34104 12:55:59.536035 tst handover.py: using BVCI 34105 12:55:59.649224 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:59.660210 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:59.671196 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:59.681939 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:59.693033 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:55:59.704059 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:55:59.820236 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:55:59.939216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:00.427338 run create_hlr_db(pid=23821): Launched 12:56:00.562576 bus /sierra_2: Setting Powered False 12:56:01.626729 run create_hlr_db(pid=23821): Terminated: ok {rc=0} 12:56:02.075431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23823): Launched 12:56:02.421736 run osmo-hlr_10.42.42.2(pid=23824): Launched 12:56:02.549614 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:03.099815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23826): Launched 12:56:03.435975 run osmo-stp_10.42.42.5(pid=23827): Launched 12:56:03.565201 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:04.139527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23829): Launched 12:56:04.473605 run osmo-msc_10.42.42.6(pid=23830): Launched 12:56:04.660315 run osmo-stp_10.42.42.5(pid=23827): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23827)] 12:56:04.800639 run osmo-stp_10.42.42.5(pid=23827): stdout: | (launched: 2022-12-13_12:56:03.374198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:04.945080 run osmo-stp_10.42.42.5(pid=23827): stderr: | 20221213125603569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125603569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125603569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125603570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125603572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125603572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125603572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:05.083696 run osmo-stp_10.42.42.5(pid=23827): stdout: | (launched: 2022-12-13_12:56:03.374198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:05.215894 run osmo-stp_10.42.42.5(pid=23827): stderr: | 20221213125603569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125603569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125603569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125603570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125603572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125603572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125603572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:05.374300 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23827): Process ended prematurely: osmo-stp_10.42.42.5(pid=23827) [trial-2389↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23827)] [trial-2389↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 12:56:05.383439 tst handover.py:18: Test FAILED (6.8 sec) 12:56:05.411241 run osmo-hlr_10.42.42.2(pid=23824): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23824)] 12:56:05.461545 run osmo-hlr_10.42.42.2(pid=23824): stdout: | (launched: 2022-12-13_12:56:02.359694) 12:56:05.513879 run osmo-hlr_10.42.42.2(pid=23824): stderr: | 20221213125602562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125602562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125602562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125602562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125602562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125602562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125602575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125602584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125602584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125602584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:05.586510 run osmo-msc_10.42.42.6(pid=23830): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23830)] 12:56:05.636470 run osmo-msc_10.42.42.6(pid=23830): stdout: | (launched: 2022-12-13_12:56:04.411417) 12:56:05.688183 run osmo-msc_10.42.42.6(pid=23830): stderr: | 20221213125604738 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125604738 DLGLOBAL DEBUG validating counter group 0x7f1ade215c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125604738 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125604738 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125604738 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125604739 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125604740 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125604741 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125604741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125604741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:05.740421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23823): Terminating (SIGTERM) 12:56:05.782335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23826): Terminating (SIGTERM) 12:56:05.824694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23829): Terminating (SIGTERM) 12:56:05.867171 --- ParallelTerminationStrategy: PID 23823 died... 12:56:05.887573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23823): Terminated: ok {rc=0} 12:56:05.934116 --- ParallelTerminationStrategy: PID 23826 died... 12:56:05.953666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23826): Terminated: ok {rc=0} 12:56:06.000287 --- ParallelTerminationStrategy: PID 23829 died... 12:56:06.020329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23829): Terminated: ok {rc=0} 12:56:06.109088 bus /sierra_3: Setting Powered False 12:56:07.210348 bus /sierra_3: Setting Powered False 12:56:08.330187 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:56:09.602552 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:09.608709 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:56:09.671213 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:56:09.699189 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:56:09.755451 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:56:09.818993 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:56:09.846840 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:56:10.400040 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:56:10.406014 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:56:10.418011 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:56:10.465131 tst handover.py: using LAC 34105 12:56:10.589191 tst handover.py: using RAC 190 12:56:10.711872 tst handover.py: using CellId 34105 12:56:10.835204 tst handover.py: using BVCI 34106 12:56:10.949931 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:56:10.999534 tst handover.py: using LAC 34106 12:56:11.130466 tst handover.py: using RAC 191 12:56:11.261974 tst handover.py: using CellId 34106 12:56:11.393751 tst handover.py: using BVCI 34107 12:56:11.509121 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:56:11.520500 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:56:11.531967 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:56:11.543626 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:56:11.555381 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:56:11.566770 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:56:11.687837 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:56:11.807463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:12.295834 run create_hlr_db(pid=23835): Launched 12:56:12.422888 bus /sierra_2: Setting Powered False 12:56:13.484462 run create_hlr_db(pid=23835): Terminated: ok {rc=0} 12:56:13.892823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23837): Launched 12:56:14.206231 run osmo-hlr_10.42.42.2(pid=23838): Launched 12:56:14.327428 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:14.850495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23840): Launched 12:56:15.163622 run osmo-stp_10.42.42.5(pid=23841): Launched 12:56:15.283033 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:15.820784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23843): Launched 12:56:16.177699 run osmo-msc_10.42.42.6(pid=23844): Launched 12:56:16.621200 run osmo-stp_10.42.42.5(pid=23841): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23841)] 12:56:16.862845 run osmo-stp_10.42.42.5(pid=23841): stdout: | (launched: 2022-12-13_12:56:15.105542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:17.003582 run osmo-stp_10.42.42.5(pid=23841): stderr: | 20221213125615279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125615279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125615279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125615280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125615280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125615280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125615281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:17.145492 run osmo-stp_10.42.42.5(pid=23841): stdout: | (launched: 2022-12-13_12:56:15.105542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:17.279990 run osmo-stp_10.42.42.5(pid=23841): stderr: | 20221213125615279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125615279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125615279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125615280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125615280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125615280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125615281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:17.438547 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23841): Process ended prematurely: osmo-stp_10.42.42.5(pid=23841) [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23841)] [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 12:56:17.447824 tst handover.py:18: Test FAILED (7.0 sec) 12:56:17.475905 run osmo-hlr_10.42.42.2(pid=23838): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23838)] 12:56:17.526589 run osmo-hlr_10.42.42.2(pid=23838): stdout: | (launched: 2022-12-13_12:56:14.147844) 12:56:17.579442 run osmo-hlr_10.42.42.2(pid=23838): stderr: | 20221213125614328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125614328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125614328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125614328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125614328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125614328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125614341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125614349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125614349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125614349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:17.652719 run osmo-msc_10.42.42.6(pid=23844): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23844)] 12:56:17.703748 run osmo-msc_10.42.42.6(pid=23844): stdout: | (launched: 2022-12-13_12:56:16.111262) 12:56:17.756131 run osmo-msc_10.42.42.6(pid=23844): stderr: | 20221213125616491 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125616492 DLGLOBAL DEBUG validating counter group 0x7fca9d909c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125616492 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125616492 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125616492 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125616492 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125616495 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125616495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125616496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125616496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:17.808804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23837): Terminating (SIGTERM) 12:56:17.851050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23840): Terminating (SIGTERM) 12:56:17.893447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23843): Terminating (SIGTERM) 12:56:17.936071 --- ParallelTerminationStrategy: PID 23837 died... 12:56:17.957003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23837): Terminated: ok {rc=0} 12:56:18.003785 --- ParallelTerminationStrategy: PID 23840 died... 12:56:18.023597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23840): Terminated: ok {rc=0} 12:56:18.070129 --- ParallelTerminationStrategy: PID 23843 died... 12:56:18.089944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23843): Terminated: ok {rc=0} 12:56:18.178083 bus /sierra_3: Setting Powered False 12:56:19.276089 bus /sierra_3: Setting Powered False 12:56:20.392634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 12:56:21.669008 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:21.674494 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:56:21.723155 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:56:21.750749 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:56:21.804476 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:56:21.853528 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:56:21.881335 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:56:22.430276 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 12:56:22.436619 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:22.448317 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 12:56:22.493764 tst handover.py: using LAC 34107 12:56:22.616406 tst handover.py: using RAC 192 12:56:22.748788 tst handover.py: using CellId 34107 12:56:22.882878 tst handover.py: using BVCI 34108 12:56:23.005623 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 12:56:23.044075 tst handover.py: using LAC 34108 12:56:23.173064 tst handover.py: using RAC 193 12:56:23.301960 tst handover.py: using CellId 34108 12:56:23.423793 tst handover.py: using BVCI 34109 12:56:23.536701 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:23.547764 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:23.558953 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:23.570189 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:23.581388 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:23.592410 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 12:56:23.713572 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 12:56:23.831964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:24.287332 run create_hlr_db(pid=23849): Launched 12:56:24.407323 bus /sierra_2: Setting Powered False 12:56:25.470096 run create_hlr_db(pid=23849): Terminated: ok {rc=0} 12:56:25.877578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23851): Launched 12:56:26.193209 run osmo-hlr_10.42.42.2(pid=23852): Launched 12:56:26.313968 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:26.836558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23854): Launched 12:56:27.148700 run osmo-stp_10.42.42.5(pid=23855): Launched 12:56:27.269535 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:27.822084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23857): Launched 12:56:28.134428 run osmo-msc_10.42.42.6(pid=23858): Launched 12:56:28.311057 run osmo-stp_10.42.42.5(pid=23855): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23855)] 12:56:28.442258 run osmo-stp_10.42.42.5(pid=23855): stdout: | (launched: 2022-12-13_12:56:27.090162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:28.572905 run osmo-stp_10.42.42.5(pid=23855): stderr: | 20221213125627263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125627263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125627264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125627264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125627266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125627266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125627266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:28.702558 run osmo-stp_10.42.42.5(pid=23855): stdout: | (launched: 2022-12-13_12:56:27.090162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:28.826293 run osmo-stp_10.42.42.5(pid=23855): stderr: | 20221213125627263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125627263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125627264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125627264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125627266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125627266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125627266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:28.974369 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23855): Process ended prematurely: osmo-stp_10.42.42.5(pid=23855) [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23855)] [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 12:56:28.982994 tst handover.py:18: Test FAILED (6.5 sec) 12:56:29.009634 run osmo-hlr_10.42.42.2(pid=23852): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23852)] 12:56:29.058729 run osmo-hlr_10.42.42.2(pid=23852): stdout: | (launched: 2022-12-13_12:56:26.134659) 12:56:29.108850 run osmo-hlr_10.42.42.2(pid=23852): stderr: | 20221213125626314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125626314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125626315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125626315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125626315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125626315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125626325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125626334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125626334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125626334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:29.179247 run osmo-msc_10.42.42.6(pid=23858): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23858)] 12:56:29.227061 run osmo-msc_10.42.42.6(pid=23858): stdout: | (launched: 2022-12-13_12:56:28.075776) 12:56:29.277180 run osmo-msc_10.42.42.6(pid=23858): stderr: | 20221213125628353 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125628354 DLGLOBAL DEBUG validating counter group 0x7faa7a146c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125628354 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125628354 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125628354 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125628354 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125628356 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125628356 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125628356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125628356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:29.327466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23851): Terminating (SIGTERM) 12:56:29.368032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23854): Terminating (SIGTERM) 12:56:29.408661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23857): Terminating (SIGTERM) 12:56:29.449593 --- ParallelTerminationStrategy: PID 23851 died... 12:56:29.469469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23851): Terminated: ok {rc=0} 12:56:29.514465 --- ParallelTerminationStrategy: PID 23854 died... 12:56:29.533952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23854): Terminated: ok {rc=0} 12:56:29.578756 --- ParallelTerminationStrategy: PID 23857 died... 12:56:29.598498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23857): Terminated: ok {rc=0} 12:56:29.684190 bus /sierra_3: Setting Powered False 12:56:30.782201 bus /sierra_3: Setting Powered False 12:56:31.904200 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 12:56:33.166640 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:33.172686 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:56:33.233025 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:56:33.259611 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:56:33.312793 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:56:33.374524 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:56:33.402196 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:56:33.956060 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 12:56:33.961896 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:56:33.973783 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:56:34.021149 tst handover.py: using LAC 34109 12:56:34.151635 tst handover.py: using RAC 194 12:56:34.283605 tst handover.py: using CellId 34109 12:56:34.415927 tst handover.py: using BVCI 34110 12:56:34.531137 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:56:34.579320 tst handover.py: using LAC 34110 12:56:34.701393 tst handover.py: using RAC 195 12:56:34.822438 tst handover.py: using CellId 34110 12:56:34.943957 tst handover.py: using BVCI 34111 12:56:35.058362 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:56:35.069517 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:56:35.080498 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:56:35.091526 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:56:35.102800 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:56:35.114091 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:56:35.235602 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:56:35.352418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:35.841267 run create_hlr_db(pid=23863): Launched 12:56:35.965461 bus /sierra_2: Setting Powered False 12:56:37.027763 run create_hlr_db(pid=23863): Terminated: ok {rc=0} 12:56:37.436798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23865): Launched 12:56:37.750716 run osmo-hlr_10.42.42.2(pid=23866): Launched 12:56:37.869690 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:38.394063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23868): Launched 12:56:38.706045 run osmo-stp_10.42.42.5(pid=23869): Launched 12:56:38.827170 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:39.362801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23871): Launched 12:56:39.676151 run osmo-msc_10.42.42.6(pid=23872): Launched 12:56:39.852016 run osmo-stp_10.42.42.5(pid=23869): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23869)] 12:56:39.983257 run osmo-stp_10.42.42.5(pid=23869): stdout: | (launched: 2022-12-13_12:56:38.647911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:40.114501 run osmo-stp_10.42.42.5(pid=23869): stderr: | 20221213125638821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125638821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125638821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125638822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125638822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125638822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125638822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:40.243936 run osmo-stp_10.42.42.5(pid=23869): stdout: | (launched: 2022-12-13_12:56:38.647911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:40.367287 run osmo-stp_10.42.42.5(pid=23869): stderr: | 20221213125638821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125638821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125638821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125638822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125638822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125638822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125638822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:40.514912 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23869): Process ended prematurely: osmo-stp_10.42.42.5(pid=23869) [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23869)] [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 12:56:40.523544 tst handover.py:18: Test FAILED (6.6 sec) 12:56:40.549897 run osmo-hlr_10.42.42.2(pid=23866): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23866)] 12:56:40.598325 run osmo-hlr_10.42.42.2(pid=23866): stdout: | (launched: 2022-12-13_12:56:37.692160) 12:56:40.648056 run osmo-hlr_10.42.42.2(pid=23866): stderr: | 20221213125637874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125637874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125637874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125637874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125637874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125637874 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125637886 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125637895 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125637895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125637895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:40.718145 run osmo-msc_10.42.42.6(pid=23872): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23872)] 12:56:40.766205 run osmo-msc_10.42.42.6(pid=23872): stdout: | (launched: 2022-12-13_12:56:39.617899) 12:56:40.816236 run osmo-msc_10.42.42.6(pid=23872): stderr: | 20221213125639895 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125639895 DLGLOBAL DEBUG validating counter group 0x7f1e23b18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125639895 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125639895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125639895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125639895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125639897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125639898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125639898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125639898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:40.866413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23865): Terminating (SIGTERM) 12:56:40.906715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23868): Terminating (SIGTERM) 12:56:40.946946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23871): Terminating (SIGTERM) 12:56:40.987438 --- ParallelTerminationStrategy: PID 23865 died... 12:56:41.011265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23865): Terminated: ok {rc=0} 12:56:41.055305 --- ParallelTerminationStrategy: PID 23868 died... 12:56:41.074270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23868): Terminated: ok {rc=0} 12:56:41.118762 --- ParallelTerminationStrategy: PID 23871 died... 12:56:41.137746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23871): Terminated: ok {rc=0} 12:56:41.221279 bus /sierra_3: Setting Powered False 12:56:42.319737 bus /sierra_3: Setting Powered False 12:56:43.436055 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 12:56:44.711290 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:44.716495 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:56:44.776096 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:56:44.802811 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:56:44.855545 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:56:44.916559 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:56:44.944079 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:56:45.492025 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 12:56:45.499112 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:56:45.511069 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:56:45.558384 tst handover.py: using LAC 34111 12:56:45.680678 tst handover.py: using RAC 196 12:56:45.801601 tst handover.py: using CellId 34111 12:56:45.959065 tst handover.py: using BVCI 34112 12:56:46.079720 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:56:46.128530 tst handover.py: using LAC 34112 12:56:46.261328 tst handover.py: using RAC 197 12:56:46.393646 tst handover.py: using CellId 34112 12:56:46.528094 tst handover.py: using BVCI 34113 12:56:46.694000 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:56:46.711286 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:56:46.727588 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:56:46.741315 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:56:46.754134 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:56:46.766173 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:56:46.889540 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:56:47.035778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:47.546672 run create_hlr_db(pid=23877): Launched 12:56:47.667379 bus /sierra_2: Setting Powered False 12:56:48.728724 run create_hlr_db(pid=23877): Terminated: ok {rc=0} 12:56:49.134126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23879): Launched 12:56:49.443825 run osmo-hlr_10.42.42.2(pid=23880): Launched 12:56:49.563449 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:50.082041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23882): Launched 12:56:50.391945 run osmo-stp_10.42.42.5(pid=23883): Launched 12:56:50.512390 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:51.043454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23885): Launched 12:56:51.364309 run osmo-msc_10.42.42.6(pid=23886): Launched 12:56:51.534536 run osmo-stp_10.42.42.5(pid=23883): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23883)] 12:56:51.662759 run osmo-stp_10.42.42.5(pid=23883): stdout: | (launched: 2022-12-13_12:56:50.334277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:51.790793 run osmo-stp_10.42.42.5(pid=23883): stderr: | 20221213125650506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125650506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125650507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125650507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125650509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125650509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125650510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:51.917858 run osmo-stp_10.42.42.5(pid=23883): stdout: | (launched: 2022-12-13_12:56:50.334277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:52.038257 run osmo-stp_10.42.42.5(pid=23883): stderr: | 20221213125650506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125650506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125650507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125650507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125650509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125650509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125650510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:52.182667 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23883): Process ended prematurely: osmo-stp_10.42.42.5(pid=23883) [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23883)] [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 12:56:52.190941 tst handover.py:18: Test FAILED (6.7 sec) 12:56:52.217441 run osmo-hlr_10.42.42.2(pid=23880): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23880)] 12:56:52.266098 run osmo-hlr_10.42.42.2(pid=23880): stdout: | (launched: 2022-12-13_12:56:49.386304) 12:56:52.315765 run osmo-hlr_10.42.42.2(pid=23880): stderr: | 20221213125649568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125649568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125649568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125649568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125649568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125649568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125649580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125649588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125649589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125649589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:52.385260 run osmo-msc_10.42.42.6(pid=23886): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23886)] 12:56:52.432651 run osmo-msc_10.42.42.6(pid=23886): stdout: | (launched: 2022-12-13_12:56:51.307984) 12:56:52.482428 run osmo-msc_10.42.42.6(pid=23886): stderr: | 20221213125651576 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125651577 DLGLOBAL DEBUG validating counter group 0x7ff3620e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125651577 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125651577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125651577 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125651577 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125651579 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125651580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125651580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125651580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:52.532310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23879): Terminating (SIGTERM) 12:56:52.572263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23882): Terminating (SIGTERM) 12:56:52.612105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23885): Terminating (SIGTERM) 12:56:52.652807 --- ParallelTerminationStrategy: PID 23879 died... 12:56:52.672338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23879): Terminated: ok {rc=0} 12:56:52.717003 --- ParallelTerminationStrategy: PID 23882 died... 12:56:52.735806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23882): Terminated: ok {rc=0} 12:56:52.779611 --- ParallelTerminationStrategy: PID 23885 died... 12:56:52.798516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23885): Terminated: ok {rc=0} 12:56:52.882273 bus /sierra_3: Setting Powered False 12:56:53.976766 bus /sierra_3: Setting Powered False 12:56:55.090604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 12:56:56.354454 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:56.359320 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:56:56.411195 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:56:56.437521 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:56:56.489694 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:56:56.542686 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:56:56.570049 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:56:57.119097 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 12:56:57.125421 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:57.136785 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 12:56:57.185077 tst handover.py: using LAC 34113 12:56:57.303905 tst handover.py: using RAC 198 12:56:57.423904 tst handover.py: using CellId 34113 12:56:57.543701 tst handover.py: using BVCI 34114 12:56:57.653539 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 12:56:57.688914 tst handover.py: using LAC 34114 12:56:57.817303 tst handover.py: using RAC 199 12:56:57.946897 tst handover.py: using CellId 34114 12:56:58.078485 tst handover.py: using BVCI 34115 12:56:58.197337 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:58.208754 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:58.219877 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:58.231022 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:58.242264 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:56:58.253518 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 12:56:58.369256 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 12:56:58.487123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:58.962512 run create_hlr_db(pid=23891): Launched 12:56:59.095494 bus /sierra_2: Setting Powered False 12:57:00.159533 run create_hlr_db(pid=23891): Terminated: ok {rc=0} 12:57:00.567537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23893): Launched 12:57:00.895435 run osmo-hlr_10.42.42.2(pid=23894): Launched 12:57:01.131847 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:01.731237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23896): Launched 12:57:02.063821 run osmo-stp_10.42.42.5(pid=23897): Launched 12:57:02.365891 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:02.923148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23899): Launched 12:57:03.250194 run osmo-msc_10.42.42.6(pid=23900): Launched 12:57:03.423225 run osmo-stp_10.42.42.5(pid=23897): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23897)] 12:57:03.553496 run osmo-stp_10.42.42.5(pid=23897): stdout: | (launched: 2022-12-13_12:57:01.993183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:03.682113 run osmo-stp_10.42.42.5(pid=23897): stderr: | 20221213125702269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125702269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125702269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125702270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125702270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125702270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125702270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:03.808118 run osmo-stp_10.42.42.5(pid=23897): stdout: | (launched: 2022-12-13_12:57:01.993183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:03.928260 run osmo-stp_10.42.42.5(pid=23897): stderr: | 20221213125702269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125702269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125702269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125702270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125702270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125702270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125702270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:04.072608 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23897): Process ended prematurely: osmo-stp_10.42.42.5(pid=23897) [trial-2389↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23897)] [trial-2389↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 12:57:04.081140 tst handover.py:18: Test FAILED (6.9 sec) 12:57:04.107238 run osmo-hlr_10.42.42.2(pid=23894): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23894)] 12:57:04.154948 run osmo-hlr_10.42.42.2(pid=23894): stdout: | (launched: 2022-12-13_12:57:00.815683) 12:57:04.204491 run osmo-hlr_10.42.42.2(pid=23894): stderr: | 20221213125701070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125701070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125701070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125701070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125701070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125701070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125701087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125701108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125701108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125701108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:04.273631 run osmo-msc_10.42.42.6(pid=23900): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23900)] 12:57:04.320636 run osmo-msc_10.42.42.6(pid=23900): stdout: | (launched: 2022-12-13_12:57:03.189576) 12:57:04.369883 run osmo-msc_10.42.42.6(pid=23900): stderr: | 20221213125703459 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125703459 DLGLOBAL DEBUG validating counter group 0x7f0a899f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125703460 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125703460 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125703460 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125703460 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125703462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125703462 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125703462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125703462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:04.419627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23893): Terminating (SIGTERM) 12:57:04.459462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23896): Terminating (SIGTERM) 12:57:04.499261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23899): Terminating (SIGTERM) 12:57:04.539486 --- ParallelTerminationStrategy: PID 23893 died... 12:57:04.559078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23893): Terminated: ok {rc=0} 12:57:04.603442 --- ParallelTerminationStrategy: PID 23896 died... 12:57:04.622434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23896): Terminated: ok {rc=0} 12:57:04.666594 --- ParallelTerminationStrategy: PID 23899 died... 12:57:04.685633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23899): Terminated: ok {rc=0} 12:57:04.772060 bus /sierra_3: Setting Powered False 12:57:05.870947 bus /sierra_3: Setting Powered False 12:57:06.986426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 12:57:08.250156 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:08.255792 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:57:08.321510 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:57:08.349163 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:57:08.404146 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:57:08.472874 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:57:08.500145 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:57:09.048799 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 12:57:09.054538 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:09.066206 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:57:09.115210 tst handover.py: using LAC 34115 12:57:09.242661 tst handover.py: using RAC 200 12:57:09.369170 tst handover.py: using CellId 34115 12:57:09.495541 tst handover.py: using BVCI 34116 12:57:09.613525 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:57:09.662349 tst handover.py: using LAC 34116 12:57:09.791803 tst handover.py: using RAC 201 12:57:09.912728 tst handover.py: using CellId 34116 12:57:10.031471 tst handover.py: using BVCI 34117 12:57:10.141897 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:10.152729 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:10.163478 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:10.174405 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:10.185575 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:10.196574 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:57:10.316816 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:57:10.435891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:10.910957 run create_hlr_db(pid=23906): Launched 12:57:11.043804 bus /sierra_2: Setting Powered False 12:57:12.107539 run create_hlr_db(pid=23906): Terminated: ok {rc=0} 12:57:12.531351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23908): Launched 12:57:12.856508 run osmo-hlr_10.42.42.2(pid=23909): Launched 12:57:12.980919 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:13.517921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23911): Launched 12:57:13.843586 run osmo-stp_10.42.42.5(pid=23912): Launched 12:57:13.967408 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:14.526885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23914): Launched 12:57:14.852917 run osmo-msc_10.42.42.6(pid=23915): Launched 12:57:15.035035 run osmo-stp_10.42.42.5(pid=23912): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23912)] 12:57:15.171269 run osmo-stp_10.42.42.5(pid=23912): stdout: | (launched: 2022-12-13_12:57:13.783608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:15.307900 run osmo-stp_10.42.42.5(pid=23912): stderr: | 20221213125713975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125713975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125713975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125713976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125713976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125713976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125713977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:15.443282 run osmo-stp_10.42.42.5(pid=23912): stdout: | (launched: 2022-12-13_12:57:13.783608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:15.571948 run osmo-stp_10.42.42.5(pid=23912): stderr: | 20221213125713975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125713975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125713975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125713976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125713976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125713976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125713977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:15.726129 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23912): Process ended prematurely: osmo-stp_10.42.42.5(pid=23912) [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23912)] [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 12:57:15.734885 tst handover.py:18: Test FAILED (6.7 sec) 12:57:15.762098 run osmo-hlr_10.42.42.2(pid=23909): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23909)] 12:57:15.811454 run osmo-hlr_10.42.42.2(pid=23909): stdout: | (launched: 2022-12-13_12:57:12.796666) 12:57:15.887343 run osmo-hlr_10.42.42.2(pid=23909): stderr: | 20221213125712996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125712996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125712996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125712996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125712996 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125712996 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125713009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125713017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125713018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125713018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:15.960853 run osmo-msc_10.42.42.6(pid=23915): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23915)] 12:57:16.012230 run osmo-msc_10.42.42.6(pid=23915): stdout: | (launched: 2022-12-13_12:57:14.792658) 12:57:16.065207 run osmo-msc_10.42.42.6(pid=23915): stderr: | 20221213125715115 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125715115 DLGLOBAL DEBUG validating counter group 0x7f4842739c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125715115 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125715115 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125715115 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125715116 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125715117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125715118 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125715118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125715118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:16.118180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23908): Terminating (SIGTERM) 12:57:16.160356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23911): Terminating (SIGTERM) 12:57:16.203375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23914): Terminating (SIGTERM) 12:57:16.247472 --- ParallelTerminationStrategy: PID 23908 died... 12:57:16.267833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23908): Terminated: ok {rc=0} 12:57:16.314714 --- ParallelTerminationStrategy: PID 23911 died... 12:57:16.334956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23911): Terminated: ok {rc=0} 12:57:16.381893 --- ParallelTerminationStrategy: PID 23914 died... 12:57:16.401856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23914): Terminated: ok {rc=0} 12:57:16.490337 bus /sierra_3: Setting Powered False 12:57:17.590367 bus /sierra_3: Setting Powered False 12:57:18.703451 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 12:57:19.974776 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:19.979834 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:57:20.042489 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:57:20.068737 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:57:20.121741 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:57:20.184816 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:57:20.211186 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:57:20.766828 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 12:57:20.772235 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:20.783781 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:57:20.840191 tst handover.py: using LAC 34117 12:57:20.966566 tst handover.py: using RAC 202 12:57:21.092206 tst handover.py: using CellId 34117 12:57:21.218994 tst handover.py: using BVCI 34118 12:57:21.335974 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:57:21.382926 tst handover.py: using LAC 34118 12:57:21.508452 tst handover.py: using RAC 203 12:57:21.633852 tst handover.py: using CellId 34118 12:57:21.759687 tst handover.py: using BVCI 34119 12:57:21.877392 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:21.888750 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:21.900052 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:21.911337 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:21.922686 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:21.933935 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:57:22.061790 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:57:22.177670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:22.618577 run create_hlr_db(pid=23920): Launched 12:57:22.733894 bus /sierra_2: Setting Powered False 12:57:23.794532 run create_hlr_db(pid=23920): Terminated: ok {rc=0} 12:57:24.210292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23922): Launched 12:57:24.534689 run osmo-hlr_10.42.42.2(pid=23923): Launched 12:57:24.659148 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:25.189343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23925): Launched 12:57:25.513728 run osmo-stp_10.42.42.5(pid=23926): Launched 12:57:25.638102 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:26.196110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23928): Launched 12:57:26.519814 run osmo-msc_10.42.42.6(pid=23929): Launched 12:57:26.702645 run osmo-stp_10.42.42.5(pid=23926): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23926)] 12:57:26.840309 run osmo-stp_10.42.42.5(pid=23926): stdout: | (launched: 2022-12-13_12:57:25.454864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:26.978258 run osmo-stp_10.42.42.5(pid=23926): stderr: | 20221213125725642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125725642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125725642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125725643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125725643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125725643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125725643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:27.114815 run osmo-stp_10.42.42.5(pid=23926): stdout: | (launched: 2022-12-13_12:57:25.454864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:27.245320 run osmo-stp_10.42.42.5(pid=23926): stderr: | 20221213125725642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125725642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125725642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125725643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125725643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125725643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125725643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:27.400555 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23926): Process ended prematurely: osmo-stp_10.42.42.5(pid=23926) [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23926)] [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 12:57:27.409463 tst handover.py:18: Test FAILED (6.6 sec) 12:57:27.436834 run osmo-hlr_10.42.42.2(pid=23923): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23923)] 12:57:27.486393 run osmo-hlr_10.42.42.2(pid=23923): stdout: | (launched: 2022-12-13_12:57:24.476092) 12:57:27.537762 run osmo-hlr_10.42.42.2(pid=23923): stderr: | 20221213125724669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125724669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125724669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125724669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125724670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125724670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125724695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125724705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125724705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125724705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:27.609746 run osmo-msc_10.42.42.6(pid=23929): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23929)] 12:57:27.659286 run osmo-msc_10.42.42.6(pid=23929): stdout: | (launched: 2022-12-13_12:57:26.460892) 12:57:27.710690 run osmo-msc_10.42.42.6(pid=23929): stderr: | 20221213125726780 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125726780 DLGLOBAL DEBUG validating counter group 0x7fc50fb0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125726781 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125726781 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125726781 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125726781 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125726783 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125726783 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125726783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125726783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:27.762461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23922): Terminating (SIGTERM) 12:57:27.803523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23925): Terminating (SIGTERM) 12:57:27.844864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23928): Terminating (SIGTERM) 12:57:27.887082 --- ParallelTerminationStrategy: PID 23922 died... 12:57:27.906949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23922): Terminated: ok {rc=0} 12:57:27.952760 --- ParallelTerminationStrategy: PID 23925 died... 12:57:27.972224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23925): Terminated: ok {rc=0} 12:57:28.018061 --- ParallelTerminationStrategy: PID 23928 died... 12:57:28.037680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23928): Terminated: ok {rc=0} 12:57:28.124022 bus /sierra_3: Setting Powered False 12:57:29.223234 bus /sierra_3: Setting Powered False 12:57:30.337912 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 12:57:31.611764 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:31.617674 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:57:31.672378 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:57:31.700848 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:57:31.757393 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:57:31.812027 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:57:31.847525 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:57:32.391454 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 12:57:32.396880 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:32.408157 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:57:32.442956 tst handover.py: using LAC 34119 12:57:32.571844 tst handover.py: using RAC 204 12:57:32.701573 tst handover.py: using CellId 34119 12:57:32.831676 tst handover.py: using BVCI 34120 12:57:32.949908 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:57:33.000155 tst handover.py: using LAC 34120 12:57:33.130937 tst handover.py: using RAC 205 12:57:33.260673 tst handover.py: using CellId 34120 12:57:33.382002 tst handover.py: using BVCI 34121 12:57:33.493009 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:33.504016 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:33.514652 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:33.525540 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:33.536525 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:57:33.547360 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:57:33.663034 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:57:33.780468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:34.259014 run create_hlr_db(pid=23934): Launched 12:57:34.392068 bus /sierra_2: Setting Powered False 12:57:35.457264 run create_hlr_db(pid=23934): Terminated: ok {rc=0} 12:57:35.867433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23936): Launched 12:57:36.173632 run osmo-hlr_10.42.42.2(pid=23937): Launched 12:57:36.291377 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:36.803707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23939): Launched 12:57:37.109594 run osmo-stp_10.42.42.5(pid=23940): Launched 12:57:37.226845 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:37.753591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23942): Launched 12:57:38.061466 run osmo-msc_10.42.42.6(pid=23943): Launched 12:57:38.233927 run osmo-stp_10.42.42.5(pid=23940): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23940)] 12:57:38.363911 run osmo-stp_10.42.42.5(pid=23940): stdout: | (launched: 2022-12-13_12:57:37.052903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:38.493881 run osmo-stp_10.42.42.5(pid=23940): stderr: | 20221213125737219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125737219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125737219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125737219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125737220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125737220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125737220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:38.621764 run osmo-stp_10.42.42.5(pid=23940): stdout: | (launched: 2022-12-13_12:57:37.052903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:38.743859 run osmo-stp_10.42.42.5(pid=23940): stderr: | 20221213125737219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125737219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125737219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125737219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125737220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125737220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125737220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:38.890295 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23940): Process ended prematurely: osmo-stp_10.42.42.5(pid=23940) [trial-2389↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23940)] [trial-2389↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 12:57:38.898666 tst handover.py:18: Test FAILED (6.5 sec) 12:57:38.924534 run osmo-hlr_10.42.42.2(pid=23937): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23937)] 12:57:38.972906 run osmo-hlr_10.42.42.2(pid=23937): stdout: | (launched: 2022-12-13_12:57:36.117409) 12:57:39.022388 run osmo-hlr_10.42.42.2(pid=23937): stderr: | 20221213125736292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125736292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125736292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125736293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125736293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125736293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125736305 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125736313 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125736313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125736313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:39.091642 run osmo-msc_10.42.42.6(pid=23943): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23943)] 12:57:39.138729 run osmo-msc_10.42.42.6(pid=23943): stdout: | (launched: 2022-12-13_12:57:38.004116) 12:57:39.187951 run osmo-msc_10.42.42.6(pid=23943): stderr: | 20221213125738274 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125738275 DLGLOBAL DEBUG validating counter group 0x7f7632015c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125738275 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125738275 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125738275 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125738275 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125738277 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125738277 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125738277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125738277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:39.237604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23936): Terminating (SIGTERM) 12:57:39.277317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23939): Terminating (SIGTERM) 12:57:39.317170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23942): Terminating (SIGTERM) 12:57:39.357553 --- ParallelTerminationStrategy: PID 23936 died... 12:57:39.377240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23936): Terminated: ok {rc=0} 12:57:39.421528 --- ParallelTerminationStrategy: PID 23939 died... 12:57:39.440487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23939): Terminated: ok {rc=0} 12:57:39.484750 --- ParallelTerminationStrategy: PID 23942 died... 12:57:39.503709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23942): Terminated: ok {rc=0} 12:57:39.590091 bus /sierra_3: Setting Powered False 12:57:40.688779 bus /sierra_3: Setting Powered False 12:57:41.804285 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 12:57:43.057967 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:43.064043 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:57:43.115931 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:57:43.143411 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:57:43.196736 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:57:43.249221 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:57:43.276619 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:57:43.827694 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 12:57:43.833129 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:43.844415 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:57:43.879975 tst handover.py: using LAC 34121 12:57:44.008865 tst handover.py: using RAC 206 12:57:44.137332 tst handover.py: using CellId 34121 12:57:44.266372 tst handover.py: using BVCI 34122 12:57:44.385266 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:57:44.437354 tst handover.py: using LAC 34122 12:57:44.566951 tst handover.py: using RAC 207 12:57:44.694820 tst handover.py: using CellId 34122 12:57:44.822437 tst handover.py: using BVCI 34123 12:57:44.940180 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:44.951423 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:44.962469 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:44.973575 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:44.985264 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:44.996538 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:57:45.112749 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:57:45.230990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:45.678094 run create_hlr_db(pid=23948): Launched 12:57:45.794905 bus /sierra_2: Setting Powered False 12:57:46.870272 run create_hlr_db(pid=23948): Terminated: ok {rc=0} 12:57:47.335920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23950): Launched 12:57:47.663792 run osmo-hlr_10.42.42.2(pid=23951): Launched 12:57:47.788167 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:48.328673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23953): Launched 12:57:48.656509 run osmo-stp_10.42.42.5(pid=23954): Launched 12:57:48.780293 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:49.307533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23956): Launched 12:57:49.614617 run osmo-msc_10.42.42.6(pid=23957): Launched 12:57:49.786124 run osmo-stp_10.42.42.5(pid=23954): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23954)] 12:57:49.915141 run osmo-stp_10.42.42.5(pid=23954): stdout: | (launched: 2022-12-13_12:57:48.596816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:50.043853 run osmo-stp_10.42.42.5(pid=23954): stderr: | 20221213125748765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125748766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125748766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125748766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125748767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125748767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125748767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:50.170760 run osmo-stp_10.42.42.5(pid=23954): stdout: | (launched: 2022-12-13_12:57:48.596816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:50.292296 run osmo-stp_10.42.42.5(pid=23954): stderr: | 20221213125748765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125748766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125748766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125748766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125748767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125748767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125748767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:50.438143 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23954): Process ended prematurely: osmo-stp_10.42.42.5(pid=23954) [trial-2389↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23954)] [trial-2389↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 12:57:50.446517 tst handover.py:18: Test FAILED (6.6 sec) 12:57:50.472718 run osmo-hlr_10.42.42.2(pid=23951): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23951)] 12:57:50.521103 run osmo-hlr_10.42.42.2(pid=23951): stdout: | (launched: 2022-12-13_12:57:47.603389) 12:57:50.570810 run osmo-hlr_10.42.42.2(pid=23951): stderr: | 20221213125747797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125747797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125747797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125747798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125747798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125747798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125747810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125747821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125747821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125747821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:50.641206 run osmo-msc_10.42.42.6(pid=23957): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23957)] 12:57:50.688607 run osmo-msc_10.42.42.6(pid=23957): stdout: | (launched: 2022-12-13_12:57:49.558053) 12:57:50.738376 run osmo-msc_10.42.42.6(pid=23957): stderr: | 20221213125749828 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125749828 DLGLOBAL DEBUG validating counter group 0x7fdd24039c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125749828 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125749828 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125749828 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125749828 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125749830 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125749831 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125749831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125749831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:50.788488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23950): Terminating (SIGTERM) 12:57:50.828620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23953): Terminating (SIGTERM) 12:57:50.869399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23956): Terminating (SIGTERM) 12:57:50.910117 --- ParallelTerminationStrategy: PID 23950 died... 12:57:50.929643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23950): Terminated: ok {rc=0} 12:57:50.974153 --- ParallelTerminationStrategy: PID 23953 died... 12:57:50.993277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23953): Terminated: ok {rc=0} 12:57:51.037768 --- ParallelTerminationStrategy: PID 23956 died... 12:57:51.056842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23956): Terminated: ok {rc=0} 12:57:51.143655 bus /sierra_3: Setting Powered False 12:57:52.242911 bus /sierra_3: Setting Powered False 12:57:53.356905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2389 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 12:57:54.611076 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:54.616072 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:57:54.679204 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:57:54.705908 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:57:54.757574 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:57:54.820036 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:57:54.846672 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:57:55.396678 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2389 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 12:57:55.401938 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:55.412663 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:57:55.460055 tst handover.py: using LAC 34123 12:57:55.579949 tst handover.py: using RAC 208 12:57:55.701429 tst handover.py: using CellId 34123 12:57:55.830288 tst handover.py: using BVCI 34124 12:57:55.948608 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:57:55.998309 tst handover.py: using LAC 34124 12:57:56.128076 tst handover.py: using RAC 209 12:57:56.257101 tst handover.py: using CellId 34124 12:57:56.384370 tst handover.py: using BVCI 34125 12:57:56.502492 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:56.513805 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:56.524829 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:56.536058 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:56.547343 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:57:56.558694 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:57:56.675051 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:57:56.796160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:57.274094 run create_hlr_db(pid=23962): Launched 12:57:57.407008 bus /sierra_2: Setting Powered False 12:57:58.471809 run create_hlr_db(pid=23962): Terminated: ok {rc=0} 12:57:58.880528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23964): Launched 12:57:59.185590 run osmo-hlr_10.42.42.2(pid=23965): Launched 12:57:59.303640 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:59.815311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23967): Launched 12:58:00.122272 run osmo-stp_10.42.42.5(pid=23968): Launched 12:58:00.238988 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:00.764716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23970): Launched 12:58:01.115041 run osmo-msc_10.42.42.6(pid=23971): Launched 12:58:01.544711 run osmo-stp_10.42.42.5(pid=23968): ERR: Terminated: ERROR {rc=1} [trial-2389↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23968)] 12:58:01.851939 run osmo-stp_10.42.42.5(pid=23968): stdout: | (launched: 2022-12-13_12:58:00.065927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:02.027133 run osmo-stp_10.42.42.5(pid=23968): stderr: | 20221213125800231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125800231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125800231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125800232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125800232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125800233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125800233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:02.257729 run osmo-stp_10.42.42.5(pid=23968): stdout: | (launched: 2022-12-13_12:58:00.065927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:02.391185 run osmo-stp_10.42.42.5(pid=23968): stderr: | 20221213125800231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213125800231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213125800231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213125800232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213125800232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213125800233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213125800233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:02.549597 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23968): Process ended prematurely: osmo-stp_10.42.42.5(pid=23968) [trial-2389↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23968)] [trial-2389↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 12:58:02.558717 tst handover.py:18: Test FAILED (7.1 sec) 12:58:02.586443 run osmo-hlr_10.42.42.2(pid=23965): ERR: Terminated: ERROR {rc=237} [trial-2389↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23965)] 12:58:02.636438 run osmo-hlr_10.42.42.2(pid=23965): stdout: | (launched: 2022-12-13_12:57:59.129309) 12:58:02.688371 run osmo-hlr_10.42.42.2(pid=23965): stderr: | 20221213125759302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213125759302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213125759302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213125759302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213125759302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213125759302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213125759314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213125759322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213125759322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213125759322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:02.760335 run osmo-msc_10.42.42.6(pid=23971): ERR: Terminated: ERROR {rc=2} [trial-2389↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23971)] 12:58:02.810188 run osmo-msc_10.42.42.6(pid=23971): stdout: | (launched: 2022-12-13_12:58:01.049800) 12:58:02.861699 run osmo-msc_10.42.42.6(pid=23971): stderr: | 20221213125801810 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213125801810 DLGLOBAL DEBUG validating counter group 0x7f75dbc64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213125801811 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213125801812 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213125801812 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213125801814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213125801821 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213125801822 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213125801822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213125801822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:02.914337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23964): Terminating (SIGTERM) 12:58:02.955966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23967): Terminating (SIGTERM) 12:58:02.998230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23970): Terminating (SIGTERM) 12:58:03.039886 --- ParallelTerminationStrategy: PID 23964 died... 12:58:03.060063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23964): Terminated: ok {rc=0} 12:58:03.106170 --- ParallelTerminationStrategy: PID 23967 died... 12:58:03.125758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23967): Terminated: ok {rc=0} 12:58:03.171929 --- ParallelTerminationStrategy: PID 23970 died... 12:58:03.191550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23970): Terminated: ok {rc=0} 12:58:03.279351 bus /sierra_3: Setting Powered False 12:58:04.377716 bus /sierra_3: Setting Powered False 12:58:05.493379 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2389 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 12:58:06.767448 tst trial-2389: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389/run.2022-12-13_11-32-52/trial-2389.xml -------------------------------------------------------------------------------------------- trial-2389 FAIL -------------------------------------------------------------------------------------------- 12:58:08.703903 tst trial-2389: trial-2389: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=14433): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14433) [trial-2389↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14433)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.5 sec) Error: osmo-stp_10.42.42.5(pid=14444): Process ended prematurely: osmo-stp_10.42.42.5(pid=14444) [trial-2389↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14444)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=14454): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14454) [trial-2389↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14454)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14464): Process ended prematurely: osmo-stp_10.42.42.5(pid=14464) [trial-2389↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14464)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14478): Process ended prematurely: osmo-stp_10.42.42.5(pid=14478) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14478)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14492): Process ended prematurely: osmo-stp_10.42.42.5(pid=14492) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14492)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14506): Process ended prematurely: osmo-stp_10.42.42.5(pid=14506) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14506)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14517): Process ended prematurely: osmo-stp_10.42.42.5(pid=14517) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14517)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14531): Process ended prematurely: osmo-stp_10.42.42.5(pid=14531) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14531)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14542): Process ended prematurely: osmo-stp_10.42.42.5(pid=14542) [trial-2389↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14542)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14556): Process ended prematurely: osmo-stp_10.42.42.5(pid=14556) [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14556)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14567): Process ended prematurely: osmo-stp_10.42.42.5(pid=14567) [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14567)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14581): Process ended prematurely: osmo-stp_10.42.42.5(pid=14581) [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14581)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14592): Process ended prematurely: osmo-stp_10.42.42.5(pid=14592) [trial-2389↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14592)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14606): Process ended prematurely: osmo-stp_10.42.42.5(pid=14606) [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14606)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14617): Process ended prematurely: osmo-stp_10.42.42.5(pid=14617) [trial-2389↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14617)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14632): Process ended prematurely: osmo-stp_10.42.42.5(pid=14632) [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14632)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14643): Process ended prematurely: osmo-stp_10.42.42.5(pid=14643) [trial-2389↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14643)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14657): Process ended prematurely: osmo-stp_10.42.42.5(pid=14657) [trial-2389↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14657)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14668): Process ended prematurely: osmo-stp_10.42.42.5(pid=14668) [trial-2389↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14668)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=14958): Process ended prematurely: osmo-stp_10.42.42.5(pid=14958) [trial-2389↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14958)] FAIL: iperf3.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14970): Process ended prematurely: osmo-stp_10.42.42.5(pid=14970) [trial-2389↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14970)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=14988): Process ended prematurely: osmo-stp_10.42.42.5(pid=14988) [trial-2389↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14988)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14998): Process ended prematurely: osmo-stp_10.42.42.5(pid=14998) [trial-2389↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14998)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15010): Process ended prematurely: osmo-stp_10.42.42.5(pid=15010) [trial-2389↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15010)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=15027): Process ended prematurely: osmo-stp_10.42.42.5(pid=15027) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15027)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=15042): Process ended prematurely: osmo-stp_10.42.42.5(pid=15042) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15042)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=15060): Process ended prematurely: osmo-stp_10.42.42.5(pid=15060) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15060)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15070): Process ended prematurely: osmo-stp_10.42.42.5(pid=15070) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15070)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15080): Process ended prematurely: osmo-stp_10.42.42.5(pid=15080) [trial-2389↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15080)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15100): Process ended prematurely: osmo-stp_10.42.42.5(pid=15100) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15100)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=15112): Process ended prematurely: osmo-stp_10.42.42.5(pid=15112) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15112)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=15130): Process ended prematurely: osmo-stp_10.42.42.5(pid=15130) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15130)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15141): Process ended prematurely: osmo-stp_10.42.42.5(pid=15141) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15141)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15151): Process ended prematurely: osmo-stp_10.42.42.5(pid=15151) [trial-2389↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15151)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=15168): Process ended prematurely: osmo-stp_10.42.42.5(pid=15168) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15168)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=15185): Process ended prematurely: osmo-stp_10.42.42.5(pid=15185) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15185)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=15203): Process ended prematurely: osmo-stp_10.42.42.5(pid=15203) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15203)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15213): Process ended prematurely: osmo-stp_10.42.42.5(pid=15213) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15213)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15223): Process ended prematurely: osmo-stp_10.42.42.5(pid=15223) [trial-2389↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15223)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15236): Process ended prematurely: osmo-stp_10.42.42.5(pid=15236) [trial-2389↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15236)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15249): Process ended prematurely: osmo-stp_10.42.42.5(pid=15249) [trial-2389↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15249)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=15257): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15257) [trial-2389↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15257)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15267): Process ended prematurely: osmo-stp_10.42.42.5(pid=15267) [trial-2389↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15267)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15276): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15276) [trial-2389↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15276)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15286): Process ended prematurely: osmo-stp_10.42.42.5(pid=15286) [trial-2389↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15286)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15300): Process ended prematurely: osmo-stp_10.42.42.5(pid=15300) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15300)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15311): Process ended prematurely: osmo-stp_10.42.42.5(pid=15311) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15311)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15332): Process ended prematurely: osmo-stp_10.42.42.5(pid=15332) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15332)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15343): Process ended prematurely: osmo-stp_10.42.42.5(pid=15343) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15343)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15357): Process ended prematurely: osmo-stp_10.42.42.5(pid=15357) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15357)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15368): Process ended prematurely: osmo-stp_10.42.42.5(pid=15368) [trial-2389↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15368)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15383): Process ended prematurely: osmo-stp_10.42.42.5(pid=15383) [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15383)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15397): Process ended prematurely: osmo-stp_10.42.42.5(pid=15397) [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15397)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15411): Process ended prematurely: osmo-stp_10.42.42.5(pid=15411) [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15411)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15422): Process ended prematurely: osmo-stp_10.42.42.5(pid=15422) [trial-2389↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15422)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15436): Process ended prematurely: osmo-stp_10.42.42.5(pid=15436) [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15436)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15447): Process ended prematurely: osmo-stp_10.42.42.5(pid=15447) [trial-2389↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15447)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15463): Process ended prematurely: osmo-stp_10.42.42.5(pid=15463) [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15463)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15474): Process ended prematurely: osmo-stp_10.42.42.5(pid=15474) [trial-2389↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15474)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15488): Process ended prematurely: osmo-stp_10.42.42.5(pid=15488) [trial-2389↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15488)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15499): Process ended prematurely: osmo-stp_10.42.42.5(pid=15499) [trial-2389↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15499)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=15517): Process ended prematurely: osmo-stp_10.42.42.5(pid=15517) [trial-2389↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15517)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=15529): Process ended prematurely: osmo-stp_10.42.42.5(pid=15529) [trial-2389↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15529)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=15547): Process ended prematurely: osmo-stp_10.42.42.5(pid=15547) [trial-2389↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15547)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15557): Process ended prematurely: osmo-stp_10.42.42.5(pid=15557) [trial-2389↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15557)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15567): Process ended prematurely: osmo-stp_10.42.42.5(pid=15567) [trial-2389↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15567)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=15586): Process ended prematurely: osmo-stp_10.42.42.5(pid=15586) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15586)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=15598): Process ended prematurely: osmo-stp_10.42.42.5(pid=15598) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15598)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=15616): Process ended prematurely: osmo-stp_10.42.42.5(pid=15616) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15616)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15626): Process ended prematurely: osmo-stp_10.42.42.5(pid=15626) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15626)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15636): Process ended prematurely: osmo-stp_10.42.42.5(pid=15636) [trial-2389↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15636)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=15653): Process ended prematurely: osmo-stp_10.42.42.5(pid=15653) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15653)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15666): Process ended prematurely: osmo-stp_10.42.42.5(pid=15666) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15666)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=15684): Process ended prematurely: osmo-stp_10.42.42.5(pid=15684) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15684)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15694): Process ended prematurely: osmo-stp_10.42.42.5(pid=15694) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15694)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15704): Process ended prematurely: osmo-stp_10.42.42.5(pid=15704) [trial-2389↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15704)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15721): Process ended prematurely: osmo-stp_10.42.42.5(pid=15721) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15721)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15737): Process ended prematurely: osmo-stp_10.42.42.5(pid=15737) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15737)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=15755): Process ended prematurely: osmo-stp_10.42.42.5(pid=15755) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15755)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15765): Process ended prematurely: osmo-stp_10.42.42.5(pid=15765) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15765)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15775): Process ended prematurely: osmo-stp_10.42.42.5(pid=15775) [trial-2389↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15775)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15792): Process ended prematurely: osmo-stp_10.42.42.5(pid=15792) [trial-2389↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15792)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15805): Process ended prematurely: osmo-stp_10.42.42.5(pid=15805) [trial-2389↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15805)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15814): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15814) [trial-2389↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15814)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15824): Process ended prematurely: osmo-stp_10.42.42.5(pid=15824) [trial-2389↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15824)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15833): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15833) [trial-2389↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15833)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15843): Process ended prematurely: osmo-stp_10.42.42.5(pid=15843) [trial-2389↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15843)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15857): Process ended prematurely: osmo-stp_10.42.42.5(pid=15857) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15857)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15868): Process ended prematurely: osmo-stp_10.42.42.5(pid=15868) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15868)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15882): Process ended prematurely: osmo-stp_10.42.42.5(pid=15882) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15882)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15893): Process ended prematurely: osmo-stp_10.42.42.5(pid=15893) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15893)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15907): Process ended prematurely: osmo-stp_10.42.42.5(pid=15907) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15907)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15918): Process ended prematurely: osmo-stp_10.42.42.5(pid=15918) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15918)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15932): Process ended prematurely: osmo-stp_10.42.42.5(pid=15932) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15932)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15943): Process ended prematurely: osmo-stp_10.42.42.5(pid=15943) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15943)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15957): Process ended prematurely: osmo-stp_10.42.42.5(pid=15957) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15957)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15968): Process ended prematurely: osmo-stp_10.42.42.5(pid=15968) [trial-2389↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15968)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15982): Process ended prematurely: osmo-stp_10.42.42.5(pid=15982) [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15982)] FAIL: mo_mt_call_osmux.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16042): Process ended prematurely: osmo-stp_10.42.42.5(pid=16042) [trial-2389↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16042)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16278): Process ended prematurely: osmo-stp_10.42.42.5(pid=16278) [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16278)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16290): Process ended prematurely: osmo-stp_10.42.42.5(pid=16290) [trial-2389↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16290)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16304): Process ended prematurely: osmo-stp_10.42.42.5(pid=16304) [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16304)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16315): Process ended prematurely: osmo-stp_10.42.42.5(pid=16315) [trial-2389↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16315)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16329): Process ended prematurely: osmo-stp_10.42.42.5(pid=16329) [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16329)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16340): Process ended prematurely: osmo-stp_10.42.42.5(pid=16340) [trial-2389↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16340)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16364): Process ended prematurely: osmo-stp_10.42.42.5(pid=16364) [trial-2389↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16364)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16730): Process ended prematurely: osmo-stp_10.42.42.5(pid=16730) [trial-2389↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16730)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=16924): Process ended prematurely: osmo-stp_10.42.42.5(pid=16924) [trial-2389↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16924)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=16936): Process ended prematurely: osmo-stp_10.42.42.5(pid=16936) [trial-2389↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16936)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=16954): Process ended prematurely: osmo-stp_10.42.42.5(pid=16954) [trial-2389↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16954)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16964): Process ended prematurely: osmo-stp_10.42.42.5(pid=16964) [trial-2389↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16964)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16974): Process ended prematurely: osmo-stp_10.42.42.5(pid=16974) [trial-2389↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16974)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=16992): Process ended prematurely: osmo-stp_10.42.42.5(pid=16992) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16992)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17004): Process ended prematurely: osmo-stp_10.42.42.5(pid=17004) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17004)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=17022): Process ended prematurely: osmo-stp_10.42.42.5(pid=17022) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17022)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=17032): Process ended prematurely: osmo-stp_10.42.42.5(pid=17032) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17032)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17042): Process ended prematurely: osmo-stp_10.42.42.5(pid=17042) [trial-2389↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17042)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=17059): Process ended prematurely: osmo-stp_10.42.42.5(pid=17059) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17059)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=17071): Process ended prematurely: osmo-stp_10.42.42.5(pid=17071) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17071)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=17089): Process ended prematurely: osmo-stp_10.42.42.5(pid=17089) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17089)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17099): Process ended prematurely: osmo-stp_10.42.42.5(pid=17099) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17099)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17109): Process ended prematurely: osmo-stp_10.42.42.5(pid=17109) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17109)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=17128): Process ended prematurely: osmo-stp_10.42.42.5(pid=17128) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17128)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17140): Process ended prematurely: osmo-stp_10.42.42.5(pid=17140) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17140)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=17159): Process ended prematurely: osmo-stp_10.42.42.5(pid=17159) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17159)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17169): Process ended prematurely: osmo-stp_10.42.42.5(pid=17169) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17169)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17179): Process ended prematurely: osmo-stp_10.42.42.5(pid=17179) [trial-2389↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17179)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=17196): Process ended prematurely: osmo-stp_10.42.42.5(pid=17196) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17196)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=17208): Process ended prematurely: osmo-stp_10.42.42.5(pid=17208) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17208)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=17256): Process ended prematurely: osmo-stp_10.42.42.5(pid=17256) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17256)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17619): Process ended prematurely: osmo-stp_10.42.42.5(pid=17619) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17619)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=17804): Process ended prematurely: osmo-stp_10.42.42.5(pid=17804) [trial-2389↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17804)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17819): Process ended prematurely: osmo-stp_10.42.42.5(pid=17819) [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17819)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17833): Process ended prematurely: osmo-stp_10.42.42.5(pid=17833) [trial-2389↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17833)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=17843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17843) [trial-2389↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17843)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17853): Process ended prematurely: osmo-stp_10.42.42.5(pid=17853) [trial-2389↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17853)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=17862): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17862) [trial-2389↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17862)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17872): Process ended prematurely: osmo-stp_10.42.42.5(pid=17872) [trial-2389↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17872)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17887): Process ended prematurely: osmo-stp_10.42.42.5(pid=17887) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17887)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17898): Process ended prematurely: osmo-stp_10.42.42.5(pid=17898) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17898)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17912): Process ended prematurely: osmo-stp_10.42.42.5(pid=17912) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17912)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17923): Process ended prematurely: osmo-stp_10.42.42.5(pid=17923) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17923)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17938): Process ended prematurely: osmo-stp_10.42.42.5(pid=17938) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17938)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17949): Process ended prematurely: osmo-stp_10.42.42.5(pid=17949) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17949)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17964): Process ended prematurely: osmo-stp_10.42.42.5(pid=17964) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17964)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17975): Process ended prematurely: osmo-stp_10.42.42.5(pid=17975) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17975)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17989): Process ended prematurely: osmo-stp_10.42.42.5(pid=17989) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17989)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18001): Process ended prematurely: osmo-stp_10.42.42.5(pid=18001) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18001)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18015): Process ended prematurely: osmo-stp_10.42.42.5(pid=18015) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18015)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18026): Process ended prematurely: osmo-stp_10.42.42.5(pid=18026) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18026)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18040): Process ended prematurely: osmo-stp_10.42.42.5(pid=18040) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18040)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18051): Process ended prematurely: osmo-stp_10.42.42.5(pid=18051) [trial-2389↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18051)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18065): Process ended prematurely: osmo-stp_10.42.42.5(pid=18065) [trial-2389↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18065)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18076): Process ended prematurely: osmo-stp_10.42.42.5(pid=18076) [trial-2389↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18076)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18095): Process ended prematurely: osmo-stp_10.42.42.5(pid=18095) [trial-2389↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18095)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18107): Process ended prematurely: osmo-stp_10.42.42.5(pid=18107) [trial-2389↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18107)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18125): Process ended prematurely: osmo-stp_10.42.42.5(pid=18125) [trial-2389↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18125)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=18138): Process ended prematurely: osmo-stp_10.42.42.5(pid=18138) [trial-2389↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18138)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18148): Process ended prematurely: osmo-stp_10.42.42.5(pid=18148) [trial-2389↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18148)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18167): Process ended prematurely: osmo-stp_10.42.42.5(pid=18167) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18167)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=18179): Process ended prematurely: osmo-stp_10.42.42.5(pid=18179) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18179)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=18198): Process ended prematurely: osmo-stp_10.42.42.5(pid=18198) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18198)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18213): Process ended prematurely: osmo-stp_10.42.42.5(pid=18213) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18213)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18223): Process ended prematurely: osmo-stp_10.42.42.5(pid=18223) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18223)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=18240): Process ended prematurely: osmo-stp_10.42.42.5(pid=18240) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18240)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18252): Process ended prematurely: osmo-stp_10.42.42.5(pid=18252) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18252)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18270): Process ended prematurely: osmo-stp_10.42.42.5(pid=18270) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18270)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=18280): Process ended prematurely: osmo-stp_10.42.42.5(pid=18280) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18280)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18290): Process ended prematurely: osmo-stp_10.42.42.5(pid=18290) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18290)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=18311): Process ended prematurely: osmo-stp_10.42.42.5(pid=18311) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18311)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18323): Process ended prematurely: osmo-stp_10.42.42.5(pid=18323) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18323)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=18341): Process ended prematurely: osmo-stp_10.42.42.5(pid=18341) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18341)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18351): Process ended prematurely: osmo-stp_10.42.42.5(pid=18351) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18351)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18361): Process ended prematurely: osmo-stp_10.42.42.5(pid=18361) [trial-2389↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18361)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18375): Process ended prematurely: osmo-stp_10.42.42.5(pid=18375) [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18375)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18563): Process ended prematurely: osmo-stp_10.42.42.5(pid=18563) [trial-2389↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18563)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=18669): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18669) [trial-2389↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18669)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18679): Process ended prematurely: osmo-stp_10.42.42.5(pid=18679) [trial-2389↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18679)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=18688): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18688) [trial-2389↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18688)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18698): Process ended prematurely: osmo-stp_10.42.42.5(pid=18698) [trial-2389↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18698)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18712): Process ended prematurely: osmo-stp_10.42.42.5(pid=18712) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18712)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18723): Process ended prematurely: osmo-stp_10.42.42.5(pid=18723) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18723)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18737): Process ended prematurely: osmo-stp_10.42.42.5(pid=18737) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18737)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18751): Process ended prematurely: osmo-stp_10.42.42.5(pid=18751) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18751)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18765): Process ended prematurely: osmo-stp_10.42.42.5(pid=18765) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18765)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18776): Process ended prematurely: osmo-stp_10.42.42.5(pid=18776) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18776)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18790): Process ended prematurely: osmo-stp_10.42.42.5(pid=18790) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18790)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18801): Process ended prematurely: osmo-stp_10.42.42.5(pid=18801) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18801)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18816): Process ended prematurely: osmo-stp_10.42.42.5(pid=18816) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18816)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18827): Process ended prematurely: osmo-stp_10.42.42.5(pid=18827) [trial-2389↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18827)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18841): Process ended prematurely: osmo-stp_10.42.42.5(pid=18841) [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18841)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18852): Process ended prematurely: osmo-stp_10.42.42.5(pid=18852) [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18852)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18867): Process ended prematurely: osmo-stp_10.42.42.5(pid=18867) [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18867)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18878): Process ended prematurely: osmo-stp_10.42.42.5(pid=18878) [trial-2389↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18878)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18892): Process ended prematurely: osmo-stp_10.42.42.5(pid=18892) [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18892)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18903): Process ended prematurely: osmo-stp_10.42.42.5(pid=18903) [trial-2389↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18903)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18918): Process ended prematurely: osmo-stp_10.42.42.5(pid=18918) [trial-2389↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18918)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18929): Process ended prematurely: osmo-stp_10.42.42.5(pid=18929) [trial-2389↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18929)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18948): Process ended prematurely: osmo-stp_10.42.42.5(pid=18948) [trial-2389↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18948)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18960): Process ended prematurely: osmo-stp_10.42.42.5(pid=18960) [trial-2389↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18960)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18978): Process ended prematurely: osmo-stp_10.42.42.5(pid=18978) [trial-2389↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18978)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18988): Process ended prematurely: osmo-stp_10.42.42.5(pid=18988) [trial-2389↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18988)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18998): Process ended prematurely: osmo-stp_10.42.42.5(pid=18998) [trial-2389↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18998)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=19016): Process ended prematurely: osmo-stp_10.42.42.5(pid=19016) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19016)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=19028): Process ended prematurely: osmo-stp_10.42.42.5(pid=19028) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19028)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=19046): Process ended prematurely: osmo-stp_10.42.42.5(pid=19046) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19046)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19057): Process ended prematurely: osmo-stp_10.42.42.5(pid=19057) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19057)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19067): Process ended prematurely: osmo-stp_10.42.42.5(pid=19067) [trial-2389↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19067)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=19085): Process ended prematurely: osmo-stp_10.42.42.5(pid=19085) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19085)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=19100): Process ended prematurely: osmo-stp_10.42.42.5(pid=19100) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19100)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=19118): Process ended prematurely: osmo-stp_10.42.42.5(pid=19118) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19118)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19128): Process ended prematurely: osmo-stp_10.42.42.5(pid=19128) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19128)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19138): Process ended prematurely: osmo-stp_10.42.42.5(pid=19138) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19138)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=19159): Process ended prematurely: osmo-stp_10.42.42.5(pid=19159) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19159)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19171): Process ended prematurely: osmo-stp_10.42.42.5(pid=19171) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19171)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=19189): Process ended prematurely: osmo-stp_10.42.42.5(pid=19189) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19189)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19199): Process ended prematurely: osmo-stp_10.42.42.5(pid=19199) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19199)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=19209): Process ended prematurely: osmo-stp_10.42.42.5(pid=19209) [trial-2389↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19209)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19227): Process ended prematurely: osmo-stp_10.42.42.5(pid=19227) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19227)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19243): Process ended prematurely: osmo-stp_10.42.42.5(pid=19243) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19243)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=19261): Process ended prematurely: osmo-stp_10.42.42.5(pid=19261) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19261)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19271): Process ended prematurely: osmo-stp_10.42.42.5(pid=19271) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19271)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19281): Process ended prematurely: osmo-stp_10.42.42.5(pid=19281) [trial-2389↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19281)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19294): Process ended prematurely: osmo-stp_10.42.42.5(pid=19294) [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19294)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19307): Process ended prematurely: osmo-stp_10.42.42.5(pid=19307) [trial-2389↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19307)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=19315): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19315) [trial-2389↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19315)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19325): Process ended prematurely: osmo-stp_10.42.42.5(pid=19325) [trial-2389↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19325)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19334): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19334) [trial-2389↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19334)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19344): Process ended prematurely: osmo-stp_10.42.42.5(pid=19344) [trial-2389↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19344)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19358): Process ended prematurely: osmo-stp_10.42.42.5(pid=19358) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19358)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19369): Process ended prematurely: osmo-stp_10.42.42.5(pid=19369) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19369)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19384): Process ended prematurely: osmo-stp_10.42.42.5(pid=19384) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19384)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19395): Process ended prematurely: osmo-stp_10.42.42.5(pid=19395) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19395)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19410): Process ended prematurely: osmo-stp_10.42.42.5(pid=19410) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19410)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19421): Process ended prematurely: osmo-stp_10.42.42.5(pid=19421) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19421)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19435): Process ended prematurely: osmo-stp_10.42.42.5(pid=19435) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19435)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19449): Process ended prematurely: osmo-stp_10.42.42.5(pid=19449) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19449)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19463): Process ended prematurely: osmo-stp_10.42.42.5(pid=19463) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19463)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19474): Process ended prematurely: osmo-stp_10.42.42.5(pid=19474) [trial-2389↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19474)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19488): Process ended prematurely: osmo-stp_10.42.42.5(pid=19488) [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19488)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19499): Process ended prematurely: osmo-stp_10.42.42.5(pid=19499) [trial-2389↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19499)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19514): Process ended prematurely: osmo-stp_10.42.42.5(pid=19514) [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19514)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19525): Process ended prematurely: osmo-stp_10.42.42.5(pid=19525) [trial-2389↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19525)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19539): Process ended prematurely: osmo-stp_10.42.42.5(pid=19539) [trial-2389↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19539)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19550): Process ended prematurely: osmo-stp_10.42.42.5(pid=19550) [trial-2389↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19550)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=19568): Process ended prematurely: osmo-stp_10.42.42.5(pid=19568) [trial-2389↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19568)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19580): Process ended prematurely: osmo-stp_10.42.42.5(pid=19580) [trial-2389↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19580)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=19598): Process ended prematurely: osmo-stp_10.42.42.5(pid=19598) [trial-2389↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19598)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19608): Process ended prematurely: osmo-stp_10.42.42.5(pid=19608) [trial-2389↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19608)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19619): Process ended prematurely: osmo-stp_10.42.42.5(pid=19619) [trial-2389↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19619)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=19636): Process ended prematurely: osmo-stp_10.42.42.5(pid=19636) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19636)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=19648): Process ended prematurely: osmo-stp_10.42.42.5(pid=19648) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19648)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=19666): Process ended prematurely: osmo-stp_10.42.42.5(pid=19666) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19666)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19676): Process ended prematurely: osmo-stp_10.42.42.5(pid=19676) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19676)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19686): Process ended prematurely: osmo-stp_10.42.42.5(pid=19686) [trial-2389↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19686)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=19985): Process ended prematurely: osmo-stp_10.42.42.5(pid=19985) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19985)] FAIL: iperf3.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=19997): Process ended prematurely: osmo-stp_10.42.42.5(pid=19997) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19997)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=20016): Process ended prematurely: osmo-stp_10.42.42.5(pid=20016) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20016)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20026): Process ended prematurely: osmo-stp_10.42.42.5(pid=20026) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20026)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20036): Process ended prematurely: osmo-stp_10.42.42.5(pid=20036) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20036)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=20054): Process ended prematurely: osmo-stp_10.42.42.5(pid=20054) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20054)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20069): Process ended prematurely: osmo-stp_10.42.42.5(pid=20069) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20069)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=20087): Process ended prematurely: osmo-stp_10.42.42.5(pid=20087) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20087)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20097): Process ended prematurely: osmo-stp_10.42.42.5(pid=20097) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20097)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20107): Process ended prematurely: osmo-stp_10.42.42.5(pid=20107) [trial-2389↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20107)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20122): Process ended prematurely: osmo-stp_10.42.42.5(pid=20122) [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20122)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20135): Process ended prematurely: osmo-stp_10.42.42.5(pid=20135) [trial-2389↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20135)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20144) [trial-2389↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20144)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20154): Process ended prematurely: osmo-stp_10.42.42.5(pid=20154) [trial-2389↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20154)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20164): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20164) [trial-2389↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20164)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20175): Process ended prematurely: osmo-stp_10.42.42.5(pid=20175) [trial-2389↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20175)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20189): Process ended prematurely: osmo-stp_10.42.42.5(pid=20189) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20189)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20200): Process ended prematurely: osmo-stp_10.42.42.5(pid=20200) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20200)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20214): Process ended prematurely: osmo-stp_10.42.42.5(pid=20214) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20214)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20225): Process ended prematurely: osmo-stp_10.42.42.5(pid=20225) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20225)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20239): Process ended prematurely: osmo-stp_10.42.42.5(pid=20239) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20239)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20250): Process ended prematurely: osmo-stp_10.42.42.5(pid=20250) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20250)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20264): Process ended prematurely: osmo-stp_10.42.42.5(pid=20264) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20264)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20275): Process ended prematurely: osmo-stp_10.42.42.5(pid=20275) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20275)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20289): Process ended prematurely: osmo-stp_10.42.42.5(pid=20289) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20289)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20300): Process ended prematurely: osmo-stp_10.42.42.5(pid=20300) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20300)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20314): Process ended prematurely: osmo-stp_10.42.42.5(pid=20314) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20314)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20325): Process ended prematurely: osmo-stp_10.42.42.5(pid=20325) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20325)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20339): Process ended prematurely: osmo-stp_10.42.42.5(pid=20339) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20339)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20351): Process ended prematurely: osmo-stp_10.42.42.5(pid=20351) [trial-2389↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20351)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20366): Process ended prematurely: osmo-stp_10.42.42.5(pid=20366) [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20366)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20378): Process ended prematurely: osmo-stp_10.42.42.5(pid=20378) [trial-2389↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20378)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=20396): Process ended prematurely: osmo-stp_10.42.42.5(pid=20396) [trial-2389↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20396)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20409): Process ended prematurely: osmo-stp_10.42.42.5(pid=20409) [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20409)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=20556): Process ended prematurely: osmo-stp_10.42.42.5(pid=20556) [trial-2389↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20556)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=20974): Process ended prematurely: osmo-stp_10.42.42.5(pid=20974) [trial-2389↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20974)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20984): Process ended prematurely: osmo-stp_10.42.42.5(pid=20984) [trial-2389↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20984)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21003): Process ended prematurely: osmo-stp_10.42.42.5(pid=21003) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21003)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21018): Process ended prematurely: osmo-stp_10.42.42.5(pid=21018) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=21036): Process ended prematurely: osmo-stp_10.42.42.5(pid=21036) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21036)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21046): Process ended prematurely: osmo-stp_10.42.42.5(pid=21046) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21046)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21056): Process ended prematurely: osmo-stp_10.42.42.5(pid=21056) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21056)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21073): Process ended prematurely: osmo-stp_10.42.42.5(pid=21073) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21073)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=21085): Process ended prematurely: osmo-stp_10.42.42.5(pid=21085) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21085)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21103): Process ended prematurely: osmo-stp_10.42.42.5(pid=21103) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21103)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21113): Process ended prematurely: osmo-stp_10.42.42.5(pid=21113) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21113)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21123): Process ended prematurely: osmo-stp_10.42.42.5(pid=21123) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21123)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21141): Process ended prematurely: osmo-stp_10.42.42.5(pid=21141) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=21156): Process ended prematurely: osmo-stp_10.42.42.5(pid=21156) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21156)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21175): Process ended prematurely: osmo-stp_10.42.42.5(pid=21175) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21175)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21185): Process ended prematurely: osmo-stp_10.42.42.5(pid=21185) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21185)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21195): Process ended prematurely: osmo-stp_10.42.42.5(pid=21195) [trial-2389↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21195)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21208): Process ended prematurely: osmo-stp_10.42.42.5(pid=21208) [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21208)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21221): Process ended prematurely: osmo-stp_10.42.42.5(pid=21221) [trial-2389↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21221)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21230): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21230) [trial-2389↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21230)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21240): Process ended prematurely: osmo-stp_10.42.42.5(pid=21240) [trial-2389↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21240)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=21249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21249) [trial-2389↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21249)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21259): Process ended prematurely: osmo-stp_10.42.42.5(pid=21259) [trial-2389↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21259)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21274): Process ended prematurely: osmo-stp_10.42.42.5(pid=21274) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21274)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21285): Process ended prematurely: osmo-stp_10.42.42.5(pid=21285) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21285)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21302): Process ended prematurely: osmo-stp_10.42.42.5(pid=21302) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21302)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21313): Process ended prematurely: osmo-stp_10.42.42.5(pid=21313) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21313)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21327): Process ended prematurely: osmo-stp_10.42.42.5(pid=21327) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21327)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21338): Process ended prematurely: osmo-stp_10.42.42.5(pid=21338) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21338)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21352): Process ended prematurely: osmo-stp_10.42.42.5(pid=21352) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21352)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21363): Process ended prematurely: osmo-stp_10.42.42.5(pid=21363) [trial-2389↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21363)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21377): Process ended prematurely: osmo-stp_10.42.42.5(pid=21377) [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21377)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21388): Process ended prematurely: osmo-stp_10.42.42.5(pid=21388) [trial-2389↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21388)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21402): Process ended prematurely: osmo-stp_10.42.42.5(pid=21402) [trial-2389↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21402)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21414): Process ended prematurely: osmo-stp_10.42.42.5(pid=21414) [trial-2389↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21414)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=21434): Process ended prematurely: osmo-stp_10.42.42.5(pid=21434) [trial-2389↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21434)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=21446): Process ended prematurely: osmo-stp_10.42.42.5(pid=21446) [trial-2389↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21446)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21464): Process ended prematurely: osmo-stp_10.42.42.5(pid=21464) [trial-2389↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21464)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21474): Process ended prematurely: osmo-stp_10.42.42.5(pid=21474) [trial-2389↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21474)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21484): Process ended prematurely: osmo-stp_10.42.42.5(pid=21484) [trial-2389↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21484)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21501): Process ended prematurely: osmo-stp_10.42.42.5(pid=21501) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21501)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21513): Process ended prematurely: osmo-stp_10.42.42.5(pid=21513) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21513)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21531): Process ended prematurely: osmo-stp_10.42.42.5(pid=21531) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21531)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21541): Process ended prematurely: osmo-stp_10.42.42.5(pid=21541) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21575): Process ended prematurely: osmo-stp_10.42.42.5(pid=21575) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21575)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=21840): Process ended prematurely: osmo-stp_10.42.42.5(pid=21840) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21840)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21856): Process ended prematurely: osmo-stp_10.42.42.5(pid=21856) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21856)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=21874): Process ended prematurely: osmo-stp_10.42.42.5(pid=21874) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21874)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21884): Process ended prematurely: osmo-stp_10.42.42.5(pid=21884) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21884)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21895): Process ended prematurely: osmo-stp_10.42.42.5(pid=21895) [trial-2389↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21895)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21908): Process ended prematurely: osmo-stp_10.42.42.5(pid=21908) [trial-2389↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21908)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21925): Process ended prematurely: osmo-stp_10.42.42.5(pid=21925) [trial-2389↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21925)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=21934): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21934) [trial-2389↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21934)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=21944): Process ended prematurely: osmo-stp_10.42.42.5(pid=21944) [trial-2389↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21944)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21958): Process ended prematurely: osmo-stp_10.42.42.5(pid=21958) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21958)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21969): Process ended prematurely: osmo-stp_10.42.42.5(pid=21969) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21969)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21983): Process ended prematurely: osmo-stp_10.42.42.5(pid=21983) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21983)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21994): Process ended prematurely: osmo-stp_10.42.42.5(pid=21994) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21994)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22009): Process ended prematurely: osmo-stp_10.42.42.5(pid=22009) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22009)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22020): Process ended prematurely: osmo-stp_10.42.42.5(pid=22020) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22020)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22034): Process ended prematurely: osmo-stp_10.42.42.5(pid=22034) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22034)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22045): Process ended prematurely: osmo-stp_10.42.42.5(pid=22045) [trial-2389↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22045)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22063): Process ended prematurely: osmo-stp_10.42.42.5(pid=22063) [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22063)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22074): Process ended prematurely: osmo-stp_10.42.42.5(pid=22074) [trial-2389↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22074)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22088): Process ended prematurely: osmo-stp_10.42.42.5(pid=22088) [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22088)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22099): Process ended prematurely: osmo-stp_10.42.42.5(pid=22099) [trial-2389↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22099)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22113): Process ended prematurely: osmo-stp_10.42.42.5(pid=22113) [trial-2389↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22113)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22124): Process ended prematurely: osmo-stp_10.42.42.5(pid=22124) [trial-2389↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22124)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=22142): Process ended prematurely: osmo-stp_10.42.42.5(pid=22142) [trial-2389↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22142)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22154): Process ended prematurely: osmo-stp_10.42.42.5(pid=22154) [trial-2389↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22154)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=22172): Process ended prematurely: osmo-stp_10.42.42.5(pid=22172) [trial-2389↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22172)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22182): Process ended prematurely: osmo-stp_10.42.42.5(pid=22182) [trial-2389↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22182)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22192): Process ended prematurely: osmo-stp_10.42.42.5(pid=22192) [trial-2389↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22192)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=22209): Process ended prematurely: osmo-stp_10.42.42.5(pid=22209) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22209)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22221): Process ended prematurely: osmo-stp_10.42.42.5(pid=22221) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22221)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=22240): Process ended prematurely: osmo-stp_10.42.42.5(pid=22240) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22240)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22250): Process ended prematurely: osmo-stp_10.42.42.5(pid=22250) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22250)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22262): Process ended prematurely: osmo-stp_10.42.42.5(pid=22262) [trial-2389↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22262)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22282): Process ended prematurely: osmo-stp_10.42.42.5(pid=22282) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22282)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22294): Process ended prematurely: osmo-stp_10.42.42.5(pid=22294) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22294)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22312): Process ended prematurely: osmo-stp_10.42.42.5(pid=22312) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22312)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22323): Process ended prematurely: osmo-stp_10.42.42.5(pid=22323) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22323)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22333): Process ended prematurely: osmo-stp_10.42.42.5(pid=22333) [trial-2389↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22333)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22352): Process ended prematurely: osmo-stp_10.42.42.5(pid=22352) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22352)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22364): Process ended prematurely: osmo-stp_10.42.42.5(pid=22364) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22364)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22382): Process ended prematurely: osmo-stp_10.42.42.5(pid=22382) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22382)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22392): Process ended prematurely: osmo-stp_10.42.42.5(pid=22392) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22392)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22402): Process ended prematurely: osmo-stp_10.42.42.5(pid=22402) [trial-2389↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22402)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22417): Process ended prematurely: osmo-stp_10.42.42.5(pid=22417) [trial-2389↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22417)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=22425): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22425) [trial-2389↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22425)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=22427): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22427) [trial-2389↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22427)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=22429): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22429) [trial-2389↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22429)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=22431): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22431) [trial-2389↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22431)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.5 sec) Error: osmo-hlr_10.42.42.2(pid=22440): Process ended prematurely: osmo-hlr_10.42.42.2(pid=22440) [trial-2389↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22440)] FAIL: esme_connect_policy_closed.py (6.2 sec) Error: osmo-hlr_10.42.42.2(pid=22451): Process ended prematurely: osmo-hlr_10.42.42.2(pid=22451) [trial-2389↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22451)] FAIL: esme_ms_sms_storeforward.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22463): Process ended prematurely: osmo-stp_10.42.42.5(pid=22463) [trial-2389↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22463)] FAIL: esme_ms_sms_transaction.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22474): Process ended prematurely: osmo-stp_10.42.42.5(pid=22474) [trial-2389↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22474)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22488): Process ended prematurely: osmo-stp_10.42.42.5(pid=22488) [trial-2389↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22488)] FAIL: register_a5_0_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22499): Process ended prematurely: osmo-stp_10.42.42.5(pid=22499) [trial-2389↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22499)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22510): Process ended prematurely: osmo-stp_10.42.42.5(pid=22510) [trial-2389↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22510)] FAIL: register_a5_3_authreq.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22521): Process ended prematurely: osmo-stp_10.42.42.5(pid=22521) [trial-2389↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22521)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.1 sec) Error: srsepc(pid=22542): Process ended prematurely: srsepc(pid=22542) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22542)] FAIL: iperf3_bidir.py (19.4 sec) Error: srsepc(pid=22558): Process ended prematurely: srsepc(pid=22558) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22558)] FAIL: iperf3_dl.py (19.3 sec) Error: srsepc(pid=22578): Process ended prematurely: srsepc(pid=22578) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22578)] FAIL: iperf3_ul.py (19.3 sec) Error: srsepc(pid=22594): Process ended prematurely: srsepc(pid=22594) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22594)] FAIL: ping.py (19.0 sec) Error: srsepc(pid=22973): Process ended prematurely: srsepc(pid=22973) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=22973)] FAIL: rrc_idle_mo_ping.py (19.0 sec) Error: srsepc(pid=23165): Process ended prematurely: srsepc(pid=23165) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23165)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=23182): Process ended prematurely: srsepc(pid=23182) [trial-2389↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23182)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23196): Process ended prematurely: osmo-stp_10.42.42.5(pid=23196) [trial-2389↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23196)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23211): Process ended prematurely: osmo-stp_10.42.42.5(pid=23211) [trial-2389↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23211)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=23225): Process ended prematurely: osmo-stp_10.42.42.5(pid=23225) [trial-2389↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23225)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23240): Process ended prematurely: osmo-stp_10.42.42.5(pid=23240) [trial-2389↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23240)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23254): Process ended prematurely: osmo-stp_10.42.42.5(pid=23254) [trial-2389↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23254)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23268): Process ended prematurely: osmo-stp_10.42.42.5(pid=23268) [trial-2389↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23268)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=23282): Process ended prematurely: osmo-stp_10.42.42.5(pid=23282) [trial-2389↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23282)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23296): Process ended prematurely: osmo-stp_10.42.42.5(pid=23296) [trial-2389↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23296)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23310): Process ended prematurely: osmo-stp_10.42.42.5(pid=23310) [trial-2389↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23310)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23324): Process ended prematurely: osmo-stp_10.42.42.5(pid=23324) [trial-2389↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23324)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23339): Process ended prematurely: osmo-stp_10.42.42.5(pid=23339) [trial-2389↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23339)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23354): Process ended prematurely: osmo-stp_10.42.42.5(pid=23354) [trial-2389↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23354)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23369): Process ended prematurely: osmo-stp_10.42.42.5(pid=23369) [trial-2389↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23369)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23383): Process ended prematurely: osmo-stp_10.42.42.5(pid=23383) [trial-2389↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23383)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=23668): Process ended prematurely: osmo-stp_10.42.42.5(pid=23668) [trial-2389↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23668)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=23682): Process ended prematurely: osmo-stp_10.42.42.5(pid=23682) [trial-2389↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23682)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=23697): Process ended prematurely: osmo-stp_10.42.42.5(pid=23697) [trial-2389↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23697)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23711): Process ended prematurely: osmo-stp_10.42.42.5(pid=23711) [trial-2389↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23711)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23725): Process ended prematurely: osmo-stp_10.42.42.5(pid=23725) [trial-2389↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23725)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23739): Process ended prematurely: osmo-stp_10.42.42.5(pid=23739) [trial-2389↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23739)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23756): Process ended prematurely: osmo-stp_10.42.42.5(pid=23756) [trial-2389↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23756)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=23770): Process ended prematurely: osmo-stp_10.42.42.5(pid=23770) [trial-2389↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23770)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23785): Process ended prematurely: osmo-stp_10.42.42.5(pid=23785) [trial-2389↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23785)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23799): Process ended prematurely: osmo-stp_10.42.42.5(pid=23799) [trial-2389↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23799)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23813): Process ended prematurely: osmo-stp_10.42.42.5(pid=23813) [trial-2389↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23813)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23827): Process ended prematurely: osmo-stp_10.42.42.5(pid=23827) [trial-2389↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23827)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=23841): Process ended prematurely: osmo-stp_10.42.42.5(pid=23841) [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23841)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23855): Process ended prematurely: osmo-stp_10.42.42.5(pid=23855) [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23855)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23869): Process ended prematurely: osmo-stp_10.42.42.5(pid=23869) [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23869)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23883): Process ended prematurely: osmo-stp_10.42.42.5(pid=23883) [trial-2389↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23883)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23897): Process ended prematurely: osmo-stp_10.42.42.5(pid=23897) [trial-2389↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23897)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23912): Process ended prematurely: osmo-stp_10.42.42.5(pid=23912) [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23912)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23926): Process ended prematurely: osmo-stp_10.42.42.5(pid=23926) [trial-2389↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23926)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23940): Process ended prematurely: osmo-stp_10.42.42.5(pid=23940) [trial-2389↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23940)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23954): Process ended prematurely: osmo-stp_10.42.42.5(pid=23954) [trial-2389↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23954)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=23968): Process ended prematurely: osmo-stp_10.42.42.5(pid=23968) [trial-2389↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23968)] + rm -rf trial-2389/inst + cd trial-2389 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-13 11:32:40 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389-run.tgz run.2022-12-13_11-32-52 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2389-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2985.tgz osmo-mgw.build-8959.tgz osmo-msc.build-29304.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30088.tgz osmo-stp.build-9255.tgz osmo-trx.build-4681.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE